Apr 14 11:50:23 user devstack@n-api.service[61698]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 11:50:23 user devstack@n-api.service[61698]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 11:50:23 2023] *** Apr 14 11:50:23 user devstack@n-api.service[61698]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 11:50:23 user devstack@n-api.service[61698]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 11:50:23 user devstack@n-api.service[61698]: nodename: user Apr 14 11:50:23 user devstack@n-api.service[61698]: machine: x86_64 Apr 14 11:50:23 user devstack@n-api.service[61698]: clock source: unix Apr 14 11:50:23 user devstack@n-api.service[61698]: pcre jit disabled Apr 14 11:50:23 user devstack@n-api.service[61698]: detected number of CPU cores: 12 Apr 14 11:50:23 user devstack@n-api.service[61698]: current working directory: / Apr 14 11:50:23 user devstack@n-api.service[61698]: detected binary path: /usr/bin/uwsgi-core Apr 14 11:50:23 user devstack@n-api.service[61698]: your processes number limit is 63637 Apr 14 11:50:23 user devstack@n-api.service[61698]: your memory page size is 4096 bytes Apr 14 11:50:23 user devstack@n-api.service[61698]: detected max file descriptor number: 2048 Apr 14 11:50:23 user devstack@n-api.service[61698]: lock engine: pthread robust mutexes Apr 14 11:50:23 user devstack@n-api.service[61698]: thunder lock: enabled Apr 14 11:50:23 user devstack@n-api.service[61698]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 11:50:23 user devstack@n-api.service[61698]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 11:50:23 user devstack@n-api.service[61698]: Python main interpreter initialized at 0x56471cd39990 Apr 14 11:50:23 user devstack@n-api.service[61698]: python threads support enabled Apr 14 11:50:23 user devstack@n-api.service[61698]: your server socket listen backlog is limited to 100 connections Apr 14 11:50:23 user devstack@n-api.service[61698]: your mercy for graceful operations on workers is 90 seconds Apr 14 11:50:23 user devstack@n-api.service[61698]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 11:50:23 user devstack@n-api.service[61698]: *** Operational MODE: preforking *** Apr 14 11:50:23 user devstack@n-api.service[61698]: *** uWSGI is running in multiple interpreter mode *** Apr 14 11:50:23 user devstack@n-api.service[61698]: spawned uWSGI master process (pid: 61698) Apr 14 11:50:23 user devstack@n-api.service[61698]: spawned uWSGI worker 1 (pid: 61699, cores: 1) Apr 14 11:50:23 user devstack@n-api.service[61698]: spawned uWSGI worker 2 (pid: 61700, cores: 1) Apr 14 11:50:23 user devstack@n-api.service[61698]: spawned uWSGI worker 3 (pid: 61701, cores: 1) Apr 14 11:50:23 user devstack@n-api.service[61698]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 11:50:24 user devstack@n-api.service[61700]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 11:50:24 user devstack@n-api.service[61699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 11:50:24 user devstack@n-api.service[61701]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 11:50:27 user devstack@n-api.service[61700]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 11:50:27 user devstack@n-api.service[61700]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 11:50:27 user devstack@n-api.service[61700]: and ``live_migration_inbound_addr`` respectively. Apr 14 11:50:27 user devstack@n-api.service[61700]: ). Its value may be silently ignored in the future. Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 11:50:27 user devstack@n-api.service[61701]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 11:50:27 user devstack@n-api.service[61701]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 11:50:27 user devstack@n-api.service[61701]: and ``live_migration_inbound_addr`` respectively. Apr 14 11:50:27 user devstack@n-api.service[61701]: ). Its value may be silently ignored in the future. Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 11:50:27 user devstack@n-api.service[61699]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 11:50:27 user devstack@n-api.service[61699]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 11:50:27 user devstack@n-api.service[61699]: and ``live_migration_inbound_addr`` respectively. Apr 14 11:50:27 user devstack@n-api.service[61699]: ). Its value may be silently ignored in the future. Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61700) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61701) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61699) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 11:50:27 user devstack@n-api.service[61700]: INFO dbcounter [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Registered counter for database nova_api Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_db.sqlalchemy.engines [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61700) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writer thread running {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61699]: INFO dbcounter [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Registered counter for database nova_api Apr 14 11:50:27 user devstack@n-api.service[61701]: INFO dbcounter [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Registered counter for database nova_api Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG nova.context [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4356620e-5366-41e8-9e39-3d2da8a8f9ba(cell1) {{(pid=61700) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61700]: INFO dbcounter [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Registered counter for database nova_cell0 Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61699) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_db.sqlalchemy.engines [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61701) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: INFO dbcounter [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Registered counter for database nova_cell1 Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writer thread running {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writer thread running {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_db.sqlalchemy.engines [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61700) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_db.sqlalchemy.engines [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61700) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writer thread running {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writer thread running {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG nova.context [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4356620e-5366-41e8-9e39-3d2da8a8f9ba(cell1) {{(pid=61701) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG nova.context [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4356620e-5366-41e8-9e39-3d2da8a8f9ba(cell1) {{(pid=61699) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61701]: INFO dbcounter [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Registered counter for database nova_cell0 Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61701]: INFO dbcounter [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Registered counter for database nova_cell1 Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:50:27 user devstack@n-api.service[61699]: INFO dbcounter [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Registered counter for database nova_cell0 Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_db.sqlalchemy.engines [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61701) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61699]: INFO dbcounter [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Registered counter for database nova_cell1 Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writer thread running {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_db.sqlalchemy.engines [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61701) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61699) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writer thread running {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61699) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: INFO dbcounter [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Registered counter for database nova_cell0 Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG oslo_db.sqlalchemy.engines [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61700) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writer thread running {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writer thread running {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writer thread running {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:27 user devstack@n-api.service[61701]: INFO dbcounter [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Registered counter for database nova_cell0 Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG oslo_db.sqlalchemy.engines [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61701) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:27 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writer thread running {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:28 user devstack@n-api.service[61699]: INFO dbcounter [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Registered counter for database nova_cell0 Apr 14 11:50:28 user devstack@n-api.service[61699]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61699) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 11:50:28 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writer thread running {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 11:50:28 user devstack@n-api.service[61700]: WARNING keystonemiddleware.auth_token [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61700]: WARNING keystonemiddleware.auth_token [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61701]: WARNING keystonemiddleware.auth_token [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61701]: WARNING keystonemiddleware.auth_token [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61700]: WARNING keystonemiddleware.auth_token [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61700]: WARNING keystonemiddleware.auth_token [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61700]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56471cd39990 pid: 61700 (default app) Apr 14 11:50:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:50:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001463 Apr 14 11:50:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 11:50:28 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:50:28 user devstack@n-api.service[61699]: WARNING keystonemiddleware.auth_token [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61699]: WARNING keystonemiddleware.auth_token [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61701]: WARNING keystonemiddleware.auth_token [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61701]: WARNING keystonemiddleware.auth_token [None req-02989a3f-7110-495b-9303-ae40eb6c34fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61701]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56471cd39990 pid: 61701 (default app) Apr 14 11:50:28 user devstack@n-api.service[61699]: WARNING keystonemiddleware.auth_token [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 11:50:28 user devstack@n-api.service[61699]: WARNING keystonemiddleware.auth_token [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 11:50:28 user devstack@n-api.service[61699]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56471cd39990 pid: 61699 (default app) Apr 14 11:52:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f98cede0-7071-484f-99b9-0e121e156ac9 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001499 Apr 14 11:52:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:37 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:37 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:37 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:37 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fef77159-517f-43bb-9e27-5f237a8cb812 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-fef77159-517f-43bb-9e27-5f237a8cb812 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444318 Apr 14 11:52:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 11:52:37 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003195 Apr 14 11:52:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:39 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-21bdcb25-7eba-4764-9552-1c0b51331f54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-21bdcb25-7eba-4764-9552-1c0b51331f54 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.341648 Apr 14 11:52:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:39 2023] POST /compute/v2.1/flavors => generated 405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 11:52:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-599271be-3254-45a0-85b8-5e13b119cd8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-599271be-3254-45a0-85b8-5e13b119cd8c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080685 Apr 14 11:52:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 11:52:40 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002452 Apr 14 11:52:42 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:42 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b984f13d-9234-408d-988c-ea48d718ee61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "id": "d1", "disk": 5}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b984f13d-9234-408d-988c-ea48d718ee61 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068372 Apr 14 11:52:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:42 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fa2dacec-9079-446f-9fb0-a7b4c01ec472 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-fa2dacec-9079-446f-9fb0-a7b4c01ec472 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032769 Apr 14 11:52:42 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 11:52:42 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004036 Apr 14 11:52:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:44 2023] GET /compute/v2.1 => generated 387 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-56982b52-36ff-4c68-bb72-0a10180dd2b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-56982b52-36ff-4c68-bb72-0a10180dd2b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070018 Apr 14 11:52:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f02a34d3-2577-4576-9f60-a6ea4092be69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f02a34d3-2577-4576-9f60-a6ea4092be69 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029101 Apr 14 11:52:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 11:52:44 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:46 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:46 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001555 Apr 14 11:52:46 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-1ed5a359-e396-4753-a87a-6150f1e04e9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-1ed5a359-e396-4753-a87a-6150f1e04e9f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059405 Apr 14 11:52:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:46 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f4bd8ae4-15e5-4c1a-98e1-0f5433e72330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f4bd8ae4-15e5-4c1a-98e1-0f5433e72330 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027240 Apr 14 11:52:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 11:52:46 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001480 Apr 14 11:52:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a06d1b28-c7e5-4032-815a-d47c827bf29c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a06d1b28-c7e5-4032-815a-d47c827bf29c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059533 Apr 14 11:52:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025050 Apr 14 11:52:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 11:52:48 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f1f6e88e-992e-4d3d-9aa5-6a0f8c409199 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Apr 14 11:52:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-df9c1896-d1c1-4cb1-9987-a05da1a61e8e admin admin] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-df9c1896-d1c1-4cb1-9987-a05da1a61e8e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.076180 Apr 14 11:52:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 11:52:50 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:52:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002384 Apr 14 11:52:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:52 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:52 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:52 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:52 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:52 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:52:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1fedbd59-491b-4629-a120-d4715710cab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1fedbd59-491b-4629-a120-d4715710cab0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.413321 Apr 14 11:52:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:52 2023] POST /compute/v2.1/flavors => generated 400 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 11:52:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f065e2ad-a503-407e-ad4b-d55e573741d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f065e2ad-a503-407e-ad4b-d55e573741d7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041290 Apr 14 11:52:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 11:52:52 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001524 Apr 14 11:52:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7c2cb494-f1b2-4697-87f0-059580008caf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7c2cb494-f1b2-4697-87f0-059580008caf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060378 Apr 14 11:52:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:54 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8c840d02-5716-4563-84a7-c647160ed4e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8c840d02-5716-4563-84a7-c647160ed4e1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027961 Apr 14 11:52:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 11:52:55 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:56 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001529 Apr 14 11:52:56 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e96b6c90-0fbd-41be-af68-d9ed28de973c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e96b6c90-0fbd-41be-af68-d9ed28de973c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060873 Apr 14 11:52:56 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:56 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:56 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-08d56e66-0f69-4300-bcf3-6860ab08a52c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-08d56e66-0f69-4300-bcf3-6860ab08a52c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025037 Apr 14 11:52:57 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 11:52:56 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:52:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:52:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001594 Apr 14 11:52:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:52:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:52:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-69dd9e27-8ec5-48c2-9f3f-49cf93649943 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-69dd9e27-8ec5-48c2-9f3f-49cf93649943 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.075213 Apr 14 11:52:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:52:58 2023] POST /compute/v2.1/flavors => generated 403 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:52:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4d865778-d9f2-4f82-bdb4-7cd24907784b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:52:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-4d865778-d9f2-4f82-bdb4-7cd24907784b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027550 Apr 14 11:52:59 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 11:52:58 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:53:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:53:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001493 Apr 14 11:53:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 11:53:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:53:00 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2072892b-a139-483e-bde8-611665e414e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:53:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2072892b-a139-483e-bde8-611665e414e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059788 Apr 14 11:53:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 11:53:00 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:53:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-171b77fe-264b-4ffd-b79b-1e175af86302 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:53:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-171b77fe-264b-4ffd-b79b-1e175af86302 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025321 Apr 14 11:53:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 11:53:00 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:53:31 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:53:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ae311fd1-b157-44b5-9bd0-37cb7a272809 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002434 Apr 14 11:53:31 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 11:53:31 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:53:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:53:31 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.089751 Apr 14 11:53:31 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 11:53:31 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:54:03 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-171b77fe-264b-4ffd-b79b-1e175af86302 admin admin] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:54:03 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-171b77fe-264b-4ffd-b79b-1e175af86302 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002512 Apr 14 11:54:03 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 11:54:03 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:54:03 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:54:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-812e2d38-cf11-40a9-bc42-c6e104e0eeeb admin admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:54:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-812e2d38-cf11-40a9-bc42-c6e104e0eeeb admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.073364 Apr 14 11:54:03 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 11:54:03 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:54:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:54:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001615 Apr 14 11:54:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 11:54:08 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:54:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:54:08 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c911a9ff-cc47-4f06-97c2-778145182639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.nano", "os-flavor-access:is_public": true, "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:54:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c911a9ff-cc47-4f06-97c2-778145182639 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068395 Apr 14 11:54:08 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 11:54:08 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:54:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d380c30f-a617-436c-97a1-05dbf592b317 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:54:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d380c30f-a617-436c-97a1-05dbf592b317 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027502 Apr 14 11:54:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 11:54:08 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:54:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:54:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4bcab54d-68f7-4901-ad7d-cd50e2608664 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002239 Apr 14 11:54:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 11:54:12 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:54:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-818c6bba-6566-4e15-aee0-aa4111fb1277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "rxtx_factor": 1.0, "name": "m1.micro", "ram": 192, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:54:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-818c6bba-6566-4e15-aee0-aa4111fb1277 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066926 Apr 14 11:54:12 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 11:54:12 2023] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:54:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-cb27cb70-af4c-4c73-b2cc-af2fdc1ac06e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:54:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-cb27cb70-af4c-4c73-b2cc-af2fdc1ac06e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025515 Apr 14 11:54:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 11:54:12 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8c5eceb-3f97-4bd3-a222-02984a03cfd6 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Action: 'create', calling method: .version_select at 0x7f437288f250>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1939454132", "metadata": {"Type": "work"}}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8c5eceb-3f97-4bd3-a222-02984a03cfd6 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:27 user devstack@n-api.service[61699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 11:56:27 user devstack@n-api.service[61699]: Accept: application/json Apr 14 11:56:27 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 11:56:27 user devstack@n-api.service[61699]: Connection: close Apr 14 11:56:27 user devstack@n-api.service[61699]: Content-Length: 122 Apr 14 11:56:27 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 11:56:27 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 11:56:27 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 11:56:27 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61699]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61699]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:27 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61699]: Apr 14 11:56:27 user devstack@n-api.service[61699]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1939454132", "metadata": {"Type": "work"}}} Apr 14 11:56:27 user devstack@n-api.service[61699]: method: Apr 14 11:56:27 user devstack@n-api.service[61699]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61699]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1939454132', 'metadata': {'Type': 'work'}}}} Apr 14 11:56:27 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise error Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8c5eceb-3f97-4bd3-a222-02984a03cfd6 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c8c5eceb-3f97-4bd3-a222-02984a03cfd6 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.408091 Apr 14 11:56:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 11:56:27 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:56:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:56:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-42d2b4c7-a658-441f-b4fc-e4604f7af640 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Action: 'create', calling method: .version_select at 0x7f43728a32e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-220803992", "metadata": {"Type": "work"}}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-42d2b4c7-a658-441f-b4fc-e4604f7af640 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:27 user devstack@n-api.service[61700]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 11:56:27 user devstack@n-api.service[61700]: Accept: application/json Apr 14 11:56:27 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 11:56:27 user devstack@n-api.service[61700]: Connection: close Apr 14 11:56:27 user devstack@n-api.service[61700]: Content-Length: 119 Apr 14 11:56:27 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 11:56:27 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 11:56:27 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 11:56:27 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61700]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61700]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:27 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61700]: Apr 14 11:56:27 user devstack@n-api.service[61700]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-220803992", "metadata": {"Type": "work"}}} Apr 14 11:56:27 user devstack@n-api.service[61700]: method: Apr 14 11:56:27 user devstack@n-api.service[61700]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 11:56:27 user devstack@n-api.service[61700]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-220803992', 'metadata': {'Type': 'work'}}}} Apr 14 11:56:27 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise error Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi '0' Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 11:56:27 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-42d2b4c7-a658-441f-b4fc-e4604f7af640 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-42d2b4c7-a658-441f-b4fc-e4604f7af640 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012586 Apr 14 11:56:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 11:56:27 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:56:27 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:56:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-aefee97f-cb59-4212-a65d-359b727eebc1 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Action: 'create', calling method: .version_select at 0x7f437297fb50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1837257560", "metadata": {"Type": "work"}}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-aefee97f-cb59-4212-a65d-359b727eebc1 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:27 user devstack@n-api.service[61701]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 11:56:27 user devstack@n-api.service[61701]: Accept: application/json Apr 14 11:56:27 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 11:56:27 user devstack@n-api.service[61701]: Connection: close Apr 14 11:56:27 user devstack@n-api.service[61701]: Content-Length: 119 Apr 14 11:56:27 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 11:56:27 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 11:56:27 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 11:56:27 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:27 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:27 user devstack@n-api.service[61701]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 11:56:27 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 11:56:27 user devstack@n-api.service[61701]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:27 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:27 user devstack@n-api.service[61701]: Apr 14 11:56:27 user devstack@n-api.service[61701]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1837257560", "metadata": {"Type": "work"}}} Apr 14 11:56:27 user devstack@n-api.service[61701]: method: Apr 14 11:56:27 user devstack@n-api.service[61701]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61701]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1837257560', 'metadata': {'Type': 'work'}}}} Apr 14 11:56:27 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise error Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi '' Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 11:56:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:56:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-aefee97f-cb59-4212-a65d-359b727eebc1 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-aefee97f-cb59-4212-a65d-359b727eebc1 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015120 Apr 14 11:56:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 11:56:27 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:56:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-29722291-e373-4e96-8793-fe36ba3583e3 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Calling method '.version_select at 0x7f43732b9b40>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-29722291-e373-4e96-8793-fe36ba3583e3 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] HTTP exception thrown: Volume tempest-invalid-1027582156 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-29722291-e373-4e96-8793-fe36ba3583e3 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:28 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1027582156 HTTP/1.1 Apr 14 11:56:28 user devstack@n-api.service[61699]: Accept: application/json Apr 14 11:56:28 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 11:56:28 user devstack@n-api.service[61699]: Connection: close Apr 14 11:56:28 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 11:56:28 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 11:56:28 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 11:56:28 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 11:56:28 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:28 user devstack@n-api.service[61699]: method: Apr 14 11:56:28 user devstack@n-api.service[61699]: exception: Volume tempest-invalid-1027582156 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: action_args: {'id': 'tempest-invalid-1027582156'} Apr 14 11:56:28 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1027582156 could not be found. (HTTP 404) (Request-ID: req-24948ee9-53d5-49a6-a4eb-ef767b04d8e0) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1027582156 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1027582156 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1027582156 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-29722291-e373-4e96-8793-fe36ba3583e3 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 404 to user: Volume tempest-invalid-1027582156 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-29722291-e373-4e96-8793-fe36ba3583e3 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1027582156" status: 404 len: 99 microversion: 2.1 time: 0.524408 Apr 14 11:56:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 11:56:27 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1027582156 => generated 99 bytes in 526 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 11:56:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bec9239e-a30a-4463-9e41-f97396d0a9b5 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010151 Apr 14 11:56:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 11:56:28 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 11:56:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c9bbb979-0bac-4ff8-a2e3-54a56bc87749 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010151 Apr 14 11:56:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 11:56:28 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 14 11:56:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-89f3c86d-b39a-4b64-b27b-cae1df057c7d tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Calling method '.version_select at 0x7f437276e4d0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-89f3c86d-b39a-4b64-b27b-cae1df057c7d tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] HTTP exception thrown: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-89f3c86d-b39a-4b64-b27b-cae1df057c7d tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:28 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/os-volumes/c895e234-b574-4d89-aae5-c6bdde09f827 HTTP/1.1 Apr 14 11:56:28 user devstack@n-api.service[61699]: Accept: application/json Apr 14 11:56:28 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 11:56:28 user devstack@n-api.service[61699]: Connection: close Apr 14 11:56:28 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 11:56:28 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 11:56:28 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 11:56:28 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 11:56:28 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:28 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:28 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:28 user devstack@n-api.service[61699]: method: Apr 14 11:56:28 user devstack@n-api.service[61699]: exception: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: action_args: {'id': 'c895e234-b574-4d89-aae5-c6bdde09f827'} Apr 14 11:56:28 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. (HTTP 404) (Request-ID: req-c622da8b-7d08-4442-8abd-3fc4daae8cee) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. Apr 14 11:56:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:56:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-89f3c86d-b39a-4b64-b27b-cae1df057c7d tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 404 to user: Volume c895e234-b574-4d89-aae5-c6bdde09f827 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-89f3c86d-b39a-4b64-b27b-cae1df057c7d tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c895e234-b574-4d89-aae5-c6bdde09f827" status: 404 len: 109 microversion: 2.1 time: 0.750701 Apr 14 11:56:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 11:56:28 2023] DELETE /compute/v2.1/os-volumes/c895e234-b574-4d89-aae5-c6bdde09f827 => generated 109 bytes in 752 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:56:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-25c7c17d-7ca3-4d46-8532-c9249408ee25 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Calling method '.version_select at 0x7f43728a20e0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-25c7c17d-7ca3-4d46-8532-c9249408ee25 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] HTTP exception thrown: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. Apr 14 11:56:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-25c7c17d-7ca3-4d46-8532-c9249408ee25 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Request method failure captured: Apr 14 11:56:29 user devstack@n-api.service[61700]: request: GET /compute/v2.1/os-volumes/b9222593-39e9-4193-8a4a-46137f52c371 HTTP/1.1 Apr 14 11:56:29 user devstack@n-api.service[61700]: Accept: application/json Apr 14 11:56:29 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 11:56:29 user devstack@n-api.service[61700]: Connection: close Apr 14 11:56:29 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 11:56:29 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 11:56:29 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 11:56:29 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 11:56:29 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT9rTyJu4JKYF6rXxM3l45bp-qIF-M63NpB8SswPPcOCsdk6vM4q2B3jF8ndp85TGzhcp24-Qh6j0QqqzotbS7RtDUMeWjEec0oX61cdFbvzQtap6Aty-Npdt-liOZj1EeOGZCmIIq_UGCrDLLpwjkAOaJslk7x-jEDHOTvSsvCGwlM Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Project-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9bb6f06bd27043aba11fbf361f65489c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9bb6f06bd27043aba11fbf361f65489c"}]}] Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Tenant-Id: 9bb6f06bd27043aba11fbf361f65489c Apr 14 11:56:29 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesNegativeTest-1981298233 Apr 14 11:56:29 user devstack@n-api.service[61700]: X-User: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:29 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 11:56:29 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 11:56:29 user devstack@n-api.service[61700]: X-User-Id: 67cd0c13376a42b980007beaa923dd83 Apr 14 11:56:29 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesNegativeTest-1981298233-project-member Apr 14 11:56:29 user devstack@n-api.service[61700]: method: Apr 14 11:56:29 user devstack@n-api.service[61700]: exception: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. Apr 14 11:56:29 user devstack@n-api.service[61700]: action_args: {'id': 'b9222593-39e9-4193-8a4a-46137f52c371'} Apr 14 11:56:29 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. (HTTP 404) (Request-ID: req-9e4c0ef9-662e-4f1b-bd53-05215ba950b1) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. Apr 14 11:56:29 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:56:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-25c7c17d-7ca3-4d46-8532-c9249408ee25 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] Returning 404 to user: Volume b9222593-39e9-4193-8a4a-46137f52c371 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:56:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-25c7c17d-7ca3-4d46-8532-c9249408ee25 tempest-VolumesNegativeTest-1981298233 tempest-VolumesNegativeTest-1981298233-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b9222593-39e9-4193-8a4a-46137f52c371" status: 404 len: 109 microversion: 2.1 time: 0.339052 Apr 14 11:56:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:56:28 2023] GET /compute/v2.1/os-volumes/b9222593-39e9-4193-8a4a-46137f52c371 => generated 109 bytes in 342 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:56:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4bf92e4e-88d7-46f2-b56e-e2e629349ed3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: .version_select at 0x7f437297e710>, body: {"keypair": {"name": "tempest-keypair-1689899826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsyIPWrTgYx5mDYmYLAUYql9c5ytzflRJOI8xt+Liz9SO5uhpL9//IuWHW3+gSIh0I3JxFjHbVn4FDFn00auhiTq2XJaAhJLeaQLZujkXhytUWDHfKLlHryI1f/amUc4g=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:49 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-4bf92e4e-88d7-46f2-b56e-e2e629349ed3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for project cc13fb093d2745e8ba0152533140b6f2. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:49 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-4bf92e4e-88d7-46f2-b56e-e2e629349ed3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for user 260d1d4ef5a1422f84f9d91224b53952 and project cc13fb093d2745e8ba0152533140b6f2. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4bf92e4e-88d7-46f2-b56e-e2e629349ed3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.420160 Apr 14 11:56:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 18/54] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 11:56:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 11:56:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1621276567", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:50 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] validate_networks() for [('a732efb0-3274-408d-aabd-725f667bc8f1', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:56:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-761931801", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "66d44260-0266-499f-82fb-d7e5bee9fcf7"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:51 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] validate_networks() for [('66d44260-0266-499f-82fb-d7e5bee9fcf7', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for user 263c47076ee94cfaaa34eff928a36fdd and project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:56:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1406afd2-dc80-4f4d-991b-0812f2f73354 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.742045 Apr 14 11:56:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:56:50 2023] POST /compute/v2.1/servers => generated 381 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:56:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-525e33da-8e65-48f6-aef6-8a58c6c172c3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-525e33da-8e65-48f6-aef6-8a58c6c172c3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:56:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-525e33da-8e65-48f6-aef6-8a58c6c172c3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-525e33da-8e65-48f6-aef6-8a58c6c172c3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1216 microversion: 2.1 time: 0.236068 Apr 14 11:56:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:56:52 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1361327346", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:52 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] validate_networks() for [('a732efb0-3274-408d-aabd-725f667bc8f1', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d57d46ed-062c-417d-b348-dc6dd76b2f9b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'create', calling method: .version_select at 0x7f4372784670>, body: {"keypair": {"name": "tempest-keypair-438477400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXuDQX5mdlneSOlaQfy+4JxDU0auroTMJCiqenRoOw2yfCd/60N23lq489zSoPdy+CApif7xFXMGBg0JnCYtsNCRaca1mNN0lFB5bW9+TQVJK0zLh1rtz82y9q/SaEasg=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-d57d46ed-062c-417d-b348-dc6dd76b2f9b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting quotas for project 1b3564d4d9634e469520a3deebe14ab6. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-d57d46ed-062c-417d-b348-dc6dd76b2f9b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting quotas for user 6b2c1e52acc8496f8f56c82fbce51105 and project 1b3564d4d9634e469520a3deebe14ab6. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d57d46ed-062c-417d-b348-dc6dd76b2f9b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124595 Apr 14 11:56:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 20/57] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:56:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Getting quotas for project 186a8d3457b646fc9085e0aac2cfda5b. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Getting quotas for user 31358bf3202e4dcb85df7f64c9d3c1d0 and project 186a8d3457b646fc9085e0aac2cfda5b. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:56:53 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:56:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2afe9a42-086d-4b8f-84e4-e9681046e9f6 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.754236 Apr 14 11:56:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:56:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ad425432-b8b7-4451-9b0f-715d254e49ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ad425432-b8b7-4451-9b0f-715d254e49ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:56:53 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-ad425432-b8b7-4451-9b0f-715d254e49ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31358bf3202e4dcb85df7f64c9d3c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a8d3457b646fc9085e0aac2cfda5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ad425432-b8b7-4451-9b0f-715d254e49ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 200 len: 1208 microversion: 2.1 time: 0.091856 Apr 14 11:56:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:56:53 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for user 263c47076ee94cfaaa34eff928a36fdd and project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:56:54 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:56:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-37b5eba9-da6f-4dbb-bb15-d9f0ebf29aad tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.832178 Apr 14 11:56:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 19/60] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:56:52 2023] POST /compute/v2.1/servers => generated 381 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:56:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ea048d58-50c3-4567-a641-e3a3d12b4cae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:54 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ea048d58-50c3-4567-a641-e3a3d12b4cae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:56:54 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ea048d58-50c3-4567-a641-e3a3d12b4cae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ea048d58-50c3-4567-a641-e3a3d12b4cae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 200 len: 1216 microversion: 2.1 time: 0.213382 Apr 14 11:56:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 21/61] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:56:54 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:56:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1373523786", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6c442217-393f-4d6e-af13-517003dddfa2"}], "security_groups": [{"name": "tempest-securitygroup--1683109007"}], "key_name": "tempest-keypair-1689899826", "user_data": "}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:56 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] validate_networks() for [('6c442217-393f-4d6e-af13-517003dddfa2', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for project cc13fb093d2745e8ba0152533140b6f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for user 260d1d4ef5a1422f84f9d91224b53952 and project cc13fb093d2745e8ba0152533140b6f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:56:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:56:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-076e278f-e10c-4ddd-8873-c2ac0598c05e tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.843011 Apr 14 11:56:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 22/62] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 11:56:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 2853 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 11:56:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:56:58 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:56:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1793780522", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "f01a9b31-3529-47ab-bd37-1b80abdf9e67"}], "security_groups": [{"name": "tempest-securitygroup--1218432804"}], "key_name": "tempest-keypair-438477400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:56:58 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:58 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:58 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:56:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ca564be8-d232-4664-9ccb-c4a583cbea67 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1276 microversion: 2.20 time: 0.310552 Apr 14 11:56:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 20/63] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:56:58 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:56:59 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] validate_networks() for [('f01a9b31-3529-47ab-bd37-1b80abdf9e67', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:56:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-441296803", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "609095b3-aa7f-45b1-a300-792fe3c6435a"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:00 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] validate_networks() for [('609095b3-aa7f-45b1-a300-792fe3c6435a', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting quotas for project 1b3564d4d9634e469520a3deebe14ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Getting quotas for user 6b2c1e52acc8496f8f56c82fbce51105 and project 1b3564d4d9634e469520a3deebe14ab6. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:01 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ad2b0c55-b1df-4b78-a7d4-7d5b065b0901 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.374819 Apr 14 11:57:01 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:56:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 11:57:01 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b56aaa21-5e62-4cde-a31c-2092ddb74107 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:01 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b56aaa21-5e62-4cde-a31c-2092ddb74107 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:01 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-b56aaa21-5e62-4cde-a31c-2092ddb74107 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:01 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b56aaa21-5e62-4cde-a31c-2092ddb74107 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1239 microversion: 2.1 time: 0.177108 Apr 14 11:57:01 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 21/65] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:01 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1239 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for user 11df88c60e4b456691d8731fe8facf38 and project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-58a08de5-38d2-4779-878d-ba393b70ec49 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.388479 Apr 14 11:57:01 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 23/66] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 11:56:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:01 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:02 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:02 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:02 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-743faac2-9617-4665-8f12-65344eb44aed tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 200 len: 1394 microversion: 2.87 time: 0.129304 Apr 14 11:57:02 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:57:01 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 1394 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Creating event network-changed:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61699) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-dc81167f-38eb-4b4b-bd29-8e8cb0b6704b req-a0180d43-c51e-4252-8592-3ffc231d1884 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61699) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61699]: INFO nova.compute.rpcapi [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 11:57:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] Releasing lock "compute-rpcapi-router" {{(pid=61699) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 11:57:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0db80311-ec65-4646-af3c-6ed83011391e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246985 Apr 14 11:57:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Creating event network-changed:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61701) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fe54575-3dcc-43f0-ad39-710482bd2427 req-813f80ed-c8d1-4242-a3e1-dd37da237632 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61701) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:02 user devstack@n-api.service[61701]: INFO nova.compute.rpcapi [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 11:57:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] Releasing lock "compute-rpcapi-router" {{(pid=61701) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 11:57:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-0fcf35a4-391e-45a2-9db8-69d6c25adefd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185435 Apr 14 11:57:03 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Creating event network-changed:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61700) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6df87803-e040-4ef9-b5ff-77d9b510b5cd req-452d49fe-547b-48c2-8056-89e04ff98db2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61700) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:05 user devstack@n-api.service[61700]: INFO nova.compute.rpcapi [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 11:57:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] Releasing lock "compute-rpcapi-router" {{(pid=61700) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 11:57:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-82f4eb90-33c8-4fb8-aee9-ae2a60e363ca None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090393 Apr 14 11:57:05 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] Creating event network-changed:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:57:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-31886b88-2b85-46d8-817f-7afd20a6d263 req-d21585f8-b119-4ffc-bd80-0dfb194b8c7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094291 Apr 14 11:57:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] Creating event network-changed:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:57:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-8742c069-8ef2-48c7-9164-b86759274d75 req-e0fe94fa-6aef-4b1e-9ed9-954234a3ec06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048915 Apr 14 11:57:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] Creating event network-changed:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 11:57:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-66064301-12cd-4a93-819a-ebfd2ec3e8a9 req-1e7094c8-d585-4437-94c7-8e3e268c0b40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041727 Apr 14 11:57:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:12 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=16 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 11:57:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-bfbc73b2-39b7-4cf6-9a69-97dc94ed3e8d req-c0bcb39f-b05d-4cce-8926-45956926c002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050512 Apr 14 11:57:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=24 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] Creating event network-vif-plugged:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:57:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-6faac2ad-692d-481e-a1e5-54c30c53b921 req-80c7baba-9a91-4b01-82bb-d02e3c7c5228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048918 Apr 14 11:57:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:13 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=16 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:57:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ec69f93b-1506-4caf-a7e7-2094e8872dec req-c389efb4-1022-4d0e-8a31-1b9f2c6c703c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037811 Apr 14 11:57:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:14 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}, {"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 11:57:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 11:57:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-20383082-3462-4e58-98ee-2dc48f8e9f1d req-c35822fe-f00b-4bfd-b2ac-d0a5db324f3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044268 Apr 14 11:57:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] Creating event network-vif-plugged:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:57:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-947ff451-5d0f-4d7e-963d-84051b57cc2f req-01b6f309-593c-4944-b6e8-a10514d0869b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056075 Apr 14 11:57:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:15 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-cdc4f05e-8555-41f2-9abf-2d7954fc1561 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Action: 'create', calling method: .version_select at 0x7f437263c940>, body: {"keypair": {"name": "tempest-keypair-331968736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcMkB0c1UH4Qtwm8SiFLUTXerz4U0APq2enYwPi8/yWkRE0BQ2u6+QDFCAZbkZ1czueB4QHKXGQgV/9QKHiS1kueXwHdrPuJh/RwtOe2sBeAn35kuAmGoqUmSVUTssnzg=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:15 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-cdc4f05e-8555-41f2-9abf-2d7954fc1561 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:15 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-cdc4f05e-8555-41f2-9abf-2d7954fc1561 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for user 390ba60eb6f3478fb8225976ee516218 and project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-cdc4f05e-8555-41f2-9abf-2d7954fc1561 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.439647 Apr 14 11:57:15 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:57:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:57:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-85d1b007-bf97-433d-a122-399163cf0f2b tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Action: 'create', calling method: .version_select at 0x7f43726bb490>, body: {"keypair": {"name": "tempest-keypair-553945765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/hlJvXTsRRVQvidTptIsRMFnw3Jy3r5uWyt2kDmqw36j4Asj/F788AI8sVwzfK2jtJbozkD60b+PDsNysUI98/94z1eLuz7MUzjnwC4PtQItCXh82r9AOr1jQqnNZSYw=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:15 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-85d1b007-bf97-433d-a122-399163cf0f2b tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting quotas for project f35ab5f0a0e2453a8c5ad32e11aca784. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:15 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-85d1b007-bf97-433d-a122-399163cf0f2b tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting quotas for user 30b06ef2f13f421c967f4c86c46e5293 and project f35ab5f0a0e2453a8c5ad32e11aca784. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-85d1b007-bf97-433d-a122-399163cf0f2b tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.404897 Apr 14 11:57:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:57:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:57:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-60b8548b-7c5b-488f-8fe3-bc95678c7309 req-c64c3385-df69-4582-b83c-bf2591ae5d7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055588 Apr 14 11:57:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 11:57:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9408ec8c-30ec-4445-8f14-2a57832b9707 req-51cdd422-869e-49f7-85e0-67fb6f61d71d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091864 Apr 14 11:57:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}, {"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:57:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:57:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-45b2ace0-4886-475d-acad-ac67e9e87a0f req-07d67f12-9144-4cc4-a015-8decfa8fad8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074271 Apr 14 11:57:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 27/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:18 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "name": "network-vif-plugged", "status": "completed", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] Creating event network-vif-plugged:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 11:57:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-de539647-f440-44d8-8ebd-1b45e167d6a5 req-4daec0f6-3b8c-45bc-8876-5394679785a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119262 Apr 14 11:57:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1977536204", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "19680b33-4490-481b-8566-09234e2ffa89"}], "security_groups": [{"name": "tempest-securitygroup--1102076477"}], "key_name": "tempest-keypair-331968736", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:20 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] validate_networks() for [('19680b33-4490-481b-8566-09234e2ffa89', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7a2ec5e9-542a-4900-a7e2-a896b4e9d483 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Action: 'create', calling method: .version_select at 0x7f4371d1c5e0>, body: {"keypair": {"name": "tempest-keypair-1235067215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK1h/THvT6cq6N0iVdaxJtF4N+zyijAbwCt203K+qT3+6nOD7jWDcOnyxbv9yde5KURkOBZ+7kcCeoteXvV9dRD/N/+bb1bDR6/Vzy+7NKcyHQueXPA551IaXtV4F3A4Q=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:20 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:20 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-7a2ec5e9-542a-4900-a7e2-a896b4e9d483 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting quotas for project ec8170ca28d84853b1e641b5acbb9708. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:20 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-7a2ec5e9-542a-4900-a7e2-a896b4e9d483 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting quotas for user 99b28366f58e4c6b95d0f9d39ae73fbe and project ec8170ca28d84853b1e641b5acbb9708. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7a2ec5e9-542a-4900-a7e2-a896b4e9d483 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082031 Apr 14 11:57:20 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:57:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "name": "network-vif-plugged", "status": "completed", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] Creating event network-vif-plugged:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 11:57:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-352a9a96-8213-4255-aff4-15a2c1cd2776 req-38dbb20b-c0bd-418a-8da2-125e12a517d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100588 Apr 14 11:57:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=15 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for user 390ba60eb6f3478fb8225976ee516218 and project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-29c8fd98-9d7b-4117-84ea-72d44b3c0139 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.375881 Apr 14 11:57:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:57:19 2023] POST /compute/v2.1/servers => generated 404 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:57:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f3e856b7-27b3-4403-8444-aff4cc13968b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:22 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f3e856b7-27b3-4403-8444-aff4cc13968b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:22 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-f3e856b7-27b3-4403-8444-aff4cc13968b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f3e856b7-27b3-4403-8444-aff4cc13968b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b" status: 200 len: 1235 microversion: 2.1 time: 0.257241 Apr 14 11:57:23 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 29/88] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:22 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b => generated 1235 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1705502030", "imageRef": "dc9523c9-daf3-4272-8e02-b92a3a7c0d83", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "23922266-3224-4b12-b7d2-0e4fd14ac4bb"}], "security_groups": [{"name": "tempest-securitygroup--225882844"}], "key_name": "tempest-keypair-553945765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:25 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:25 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] validate_networks() for [('23922266-3224-4b12-b7d2-0e4fd14ac4bb', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-92977634", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "0a15f87a-0ea8-4073-a37d-3c81f8de3dc4"}], "security_groups": [{"name": "tempest-securitygroup--1240777945"}], "key_name": "tempest-keypair-1235067215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:26 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] validate_networks() for [('0a15f87a-0ea8-4073-a37d-3c81f8de3dc4', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=21 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting quotas for project f35ab5f0a0e2453a8c5ad32e11aca784. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Getting quotas for user 30b06ef2f13f421c967f4c86c46e5293 and project f35ab5f0a0e2453a8c5ad32e11aca784. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dc9523c9-daf3-4272-8e02-b92a3a7c0d83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-64e81697-7a8a-46e3-a82a-f1aaa12dc002 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.525153 Apr 14 11:57:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 31/89] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:57:25 2023] POST /compute/v2.1/servers => generated 403 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:57:26 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-03a11fae-72af-4ed7-b005-b6132ad524ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:26 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-03a11fae-72af-4ed7-b005-b6132ad524ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:27 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-03a11fae-72af-4ed7-b005-b6132ad524ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b06ef2f13f421c967f4c86c46e5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35ab5f0a0e2453a8c5ad32e11aca784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-03a11fae-72af-4ed7-b005-b6132ad524ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 200 len: 1239 microversion: 2.1 time: 0.089255 Apr 14 11:57:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:26 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting quotas for project ec8170ca28d84853b1e641b5acbb9708. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Getting quotas for user 99b28366f58e4c6b95d0f9d39ae73fbe and project ec8170ca28d84853b1e641b5acbb9708. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5600870d-bdc6-4ed6-ab49-c4844bdf95e8 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.789445 Apr 14 11:57:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:57:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:57:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2bbed0ae-fac1-45de-bd2b-665784260054 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:28 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2bbed0ae-fac1-45de-bd2b-665784260054 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:28 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-2bbed0ae-fac1-45de-bd2b-665784260054 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b28366f58e4c6b95d0f9d39ae73fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8170ca28d84853b1e641b5acbb9708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2bbed0ae-fac1-45de-bd2b-665784260054 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20" status: 200 len: 1224 microversion: 2.1 time: 0.143804 Apr 14 11:57:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:28 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:30 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=16 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] Creating event network-changed:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 11:57:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-9f5e1eac-8cc3-41a6-b15f-211d17336e41 req-e36ab77c-ad22-4aab-ba7e-848ed0edd493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083800 Apr 14 11:57:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] Creating event network-changed:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:57:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4e4f67ff-cf53-48dc-a168-9ac7b8c508bc req-744fb88d-aae5-4053-90be-f55c61413447 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044525 Apr 14 11:57:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "name": "network-vif-plugged", "status": "completed", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] Creating event network-vif-plugged:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 11:57:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] Creating event network-changed:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 11:57:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-c13444c9-5d2f-4daf-94a1-5575edd8cb2d req-2f4bf3bc-4771-40d5-b9fd-ee426786c28e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096957 Apr 14 11:57:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-94980675-fcd1-49e1-96d8-a03d6ee5fe2d req-cab18350-0b57-4918-a42c-65a1181b939f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130698 Apr 14 11:57:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "name": "network-vif-plugged", "status": "completed", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}, {"server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "name": "network-vif-plugged", "status": "completed", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Creating event network-vif-plugged:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 11:57:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] Creating event network-vif-plugged:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:57:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-cfd962e3-37a7-40c0-9b45-7e1cf2b1cdce req-d7f22832-1cff-4a68-a2b6-3a9412e38017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045462 Apr 14 11:57:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:57:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=12 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "name": "network-vif-plugged", "status": "completed", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] Creating event network-vif-plugged:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 11:57:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-798c43d3-8375-4b03-8f64-06b43e8c042c req-eb025b6d-4a57-460f-8a4b-fd890a25aece service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095037 Apr 14 11:57:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "name": "network-vif-plugged", "status": "completed", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] Creating event network-vif-plugged:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:57:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-9ccc6223-5207-40aa-8b85-ca4e5c9f5e15 req-b299d219-6889-4517-921e-fdded4496e11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046795 Apr 14 11:57:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "name": "network-vif-plugged", "status": "completed", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] Creating event network-vif-plugged:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 11:57:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-ec962b1d-0886-459a-a135-39fb1bf9f64c req-d6dc78b8-394c-49b0-a0b3-603988926664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066287 Apr 14 11:57:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:44 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31358bf3202e4dcb85df7f64c9d3c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a8d3457b646fc9085e0aac2cfda5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-88a1f531-4f55-4282-ba61-55fc361461ed tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 200 len: 1489 microversion: 2.1 time: 0.755828 Apr 14 11:57:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 34/101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:44 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 1489 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b86fdf7d-cfa6-4b68-a4ab-883f2d5eb9b1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 200 len: 1504 microversion: 2.1 time: 0.562990 Apr 14 11:57:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:44 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5ead2da5-2805-4059-b530-6fecf5915b7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: .version_select at 0x7f437263fd90>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-565940781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFIiKeQ/0Z0VfNZ6VUUlM9T5nZwFyI0LyXC8IRlH9W30muvQjtYrEeJ005baAqyTH/3Er2lAxmVvPn8aYg78pz/L256wjoD0MsMUEVdNJFcrEot77mjLycf8/vwxTsgA=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:47 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5ead2da5-2805-4059-b530-6fecf5915b7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:47 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5ead2da5-2805-4059-b530-6fecf5915b7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for user 2eb32a03e7e04da18568294cca0e69bd and project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5ead2da5-2805-4059-b530-6fecf5915b7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114115 Apr 14 11:57:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:57:47 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1398086214", "imageRef": "e352d0f0-b1ad-42b1-b85d-d82679cbae9f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-565940781", "networks": [{"uuid": "c96cae42-6598-4610-a86f-165acef484f3"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:47 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] validate_networks() for [('c96cae42-6598-4610-a86f-165acef484f3', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for user 2eb32a03e7e04da18568294cca0e69bd and project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e352d0f0-b1ad-42b1-b85d-d82679cbae9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b0344f3e-dc7f-490f-ad0f-b1e56d715658 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Action: 'create', calling method: .version_select at 0x7f43726efd00>, body: {"keypair": {"name": "tempest-keypair-1582248460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8pCTfR+4x+dFuDqyKyxy1bxHFgejN0hgRtVsu6XEkeaRltbkYzADt0drOgVBGcWJi06e8ISFLm7RM9RU7CaO9PIzNV/LFKaqyxakS+cSI5SHHsVUiLeego6xfLAzgaw=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:48 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b0344f3e-dc7f-490f-ad0f-b1e56d715658 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting quotas for project 01aedc5467e84f3788269d2f35ff4cb0. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:48 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b0344f3e-dc7f-490f-ad0f-b1e56d715658 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting quotas for user 07e15f00ba92432e9c4a222e1b40c9ab and project 01aedc5467e84f3788269d2f35ff4cb0. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-641c0ad6-f869-4bca-a03e-5087dd5737d9 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.926548 Apr 14 11:57:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 35/104] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:57:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:57:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b0344f3e-dc7f-490f-ad0f-b1e56d715658 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.093883 Apr 14 11:57:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 36/105] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 11:57:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 11:57:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b874f69e-b947-466e-9c7f-ec6793d7b097 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b874f69e-b947-466e-9c7f-ec6793d7b097 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:48 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-b874f69e-b947-466e-9c7f-ec6793d7b097 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b874f69e-b947-466e-9c7f-ec6793d7b097 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1252 microversion: 2.1 time: 0.100183 Apr 14 11:57:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:48 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1252 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:49 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-21ef6869-3641-4805-8ad6-bb7159a057ff tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1588 microversion: 2.20 time: 0.318884 Apr 14 11:57:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:57:49 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1588 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:57:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1172436186", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "8efae657-134b-4684-b335-14ca3539ebe3"}, {"port": "314dd23d-4b31-40a2-9a19-37613754a61b", "tag": "port-1"}, {"port": "3ee869ed-353a-4e35-b0d9-57f8441c91ff", "tag": "port-2"}, {"uuid": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319", "tag": "net-1"}, {"uuid": "74a9d6f0-ffb5-47ab-87a6-1c52030f9319"}, {"uuid": "e413ef89-d659-445f-96cb-9dc71be4a9db", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e413ef89-d659-445f-96cb-9dc71be4a9db", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a4b6d7b7-aee4-4c93-8b51-fe6da314cb89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fb07ad60-62ba-467a-87a2-abe53abda98b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "84ffdf09-b386-4f7b-956b-087ab6d671eb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1453771092"}], "key_name": "tempest-keypair-1582248460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9ec194ad-19bb-4bb0-8e47-91e9631b1211 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Action: 'create', calling method: .version_select at 0x7f437263c820>, body: {"keypair": {"name": "tempest-keypair-342216412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0O5tJdv4PZ0tBh/2spI+4SW7CH9GCfhaD4Y4T0lMf09XtiLfwxIWh695Ked03aSglBrEdLuq0+Xl5D5zr9mSoRp3OhmjV2PDXdy+VOFNmnc80KlENOeGJ3qIrfx+ONbg=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:51 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=7 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:51 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-9ec194ad-19bb-4bb0-8e47-91e9631b1211 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting quotas for project 62161098b7244829bdeba1cfd1d6b970. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:51 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-9ec194ad-19bb-4bb0-8e47-91e9631b1211 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting quotas for user e0497d49f8544fe6b28101364faaadd7 and project 62161098b7244829bdeba1cfd1d6b970. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9ec194ad-19bb-4bb0-8e47-91e9631b1211 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.100071 Apr 14 11:57:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 36/108] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 11:57:50 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 11:57:51 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] validate_networks() for [('8efae657-134b-4684-b335-14ca3539ebe3', None, None, None, None, None), (None, None, '314dd23d-4b31-40a2-9a19-37613754a61b', None, None, None), (None, None, '3ee869ed-353a-4e35-b0d9-57f8441c91ff', None, None, None), ('74a9d6f0-ffb5-47ab-87a6-1c52030f9319', None, None, None, None, None), ('74a9d6f0-ffb5-47ab-87a6-1c52030f9319', None, None, None, None, None), ('e413ef89-d659-445f-96cb-9dc71be4a9db', '10.2.2.100', None, None, None, None), ('e413ef89-d659-445f-96cb-9dc71be4a9db', '10.2.2.200', None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:51 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-571f80d9-8556-405a-83b2-2b86c29518ed tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1554 microversion: 2.1 time: 0.310194 Apr 14 11:57:51 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:57:51 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=9 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] Creating event network-changed:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 11:57:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-e3180f43-68a6-416b-8fbd-758e41ee2173 req-aecce16d-022f-4309-83a4-4ac8f324bd1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055362 Apr 14 11:57:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 38/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8b655fd4-22fe-41dc-a2e9-4a92457d283f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 200 len: 1691 microversion: 2.87 time: 0.342085 Apr 14 11:57:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 37/111] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:57:52 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 1691 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:57:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-508386442", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c"}, {"port": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79", "tag": "port-1"}, {"port": "56378bcd-5459-47e7-8424-345fc574ebc7", "tag": "port-2"}, {"uuid": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d", "tag": "net-1"}, {"uuid": "b94dcf66-3a7d-4c79-a7b2-f528ee9f436d"}, {"uuid": "63c80e08-8e48-4181-a64b-db7a6a669350", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "63c80e08-8e48-4181-a64b-db7a6a669350", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "895ab6a9-dbf3-4601-a05b-a462b92efde9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a8da01ce-a845-488b-8e7d-049d79697c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "dda8c2c2-a10a-40f4-99f7-8b65ac91d938", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1846382228"}], "key_name": "tempest-keypair-342216412", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:53 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] validate_networks() for [('ac5ea2af-b7f2-4146-8bc9-65d546a3fe9c', None, None, None, None, None), (None, None, 'a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79', None, None, None), (None, None, '56378bcd-5459-47e7-8424-345fc574ebc7', None, None, None), ('b94dcf66-3a7d-4c79-a7b2-f528ee9f436d', None, None, None, None, None), ('b94dcf66-3a7d-4c79-a7b2-f528ee9f436d', None, None, None, None, None), ('63c80e08-8e48-4181-a64b-db7a6a669350', '10.2.2.100', None, None, None, None), ('63c80e08-8e48-4181-a64b-db7a6a669350', '10.2.2.200', None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting quotas for project 01aedc5467e84f3788269d2f35ff4cb0. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:53 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Getting quotas for user 07e15f00ba92432e9c4a222e1b40c9ab and project 01aedc5467e84f3788269d2f35ff4cb0. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a4b6d7b7-aee4-4c93-8b51-fe6da314cb89',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fb07ad60-62ba-467a-87a2-abe53abda98b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84ffdf09-b386-4f7b-956b-087ab6d671eb',volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b297236a-3d2d-48b0-ad51-989e0463ca3a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.647259 Apr 14 11:57:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 37/112] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 11:57:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 3649 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 11:57:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a95f6495-2371-401c-bc94-88db6ba3d2ce tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 200 len: 1280 microversion: 2.42 time: 0.107411 Apr 14 11:57:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 38/113] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:57:54 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 11:57:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7174bd65-ca3b-41a6-b4bd-970c67e1d8f9 req-24ab3e5d-894f-4673-bf8f-32427b3221ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085121 Apr 14 11:57:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 38/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting quotas for project 62161098b7244829bdeba1cfd1d6b970. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Getting quotas for user e0497d49f8544fe6b28101364faaadd7 and project 62161098b7244829bdeba1cfd1d6b970. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:57:56 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='895ab6a9-dbf3-4601-a05b-a462b92efde9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a8da01ce-a845-488b-8e7d-049d79697c6f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dda8c2c2-a10a-40f4-99f7-8b65ac91d938',volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:57:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-193ae56f-3768-4cad-a8c0-9dbb2ed777a1 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.909755 Apr 14 11:57:56 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 39/115] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 11:57:53 2023] POST /compute/v2.1/servers => generated 404 bytes in 3912 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 11:57:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:57:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:57:57 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=16 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:57:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 11:57:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b53797c3-0ce8-4381-9af5-a6440e390b12 req-c2a4aeb3-bac9-44ce-ba3e-634e917a9605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045421 Apr 14 11:57:57 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:57:57 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:57 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:57 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:57:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-039c3e7a-cff5-4e40-b968-41c0997a92a6 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 200 len: 1278 microversion: 2.32 time: 0.096995 Apr 14 11:57:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 39/117] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:57:57 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:58:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:02 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=31 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] Creating event network-changed:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-4ad7968c-0834-49d2-ae23-29ce8f25b8d5 req-7cd3aa96-2c4e-4479-b4dc-edcb7af31089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039910 Apr 14 11:58:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "e643b092-2a68-4a03-810c-74731525841b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] Creating event network-changed:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-d293b74e-be6d-4680-bd1f-f68207baa71b req-d6ee40c6-5ad8-4fb3-bfd8-78e6cdea9731 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036425 Apr 14 11:58:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "314dd23d-4b31-40a2-9a19-37613754a61b"}, {"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "3ee869ed-353a-4e35-b0d9-57f8441c91ff"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:04 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Creating event network-changed:314dd23d-4b31-40a2-9a19-37613754a61b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] Creating event network-changed:3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-676fc82e-2da7-4ff4-97b3-406f7d02c086 req-4d06158f-0ec4-4b75-80a9-398db71e75ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041991 Apr 14 11:58:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=12 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79"}, {"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "56378bcd-5459-47e7-8424-345fc574ebc7"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Creating event network-changed:a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] Creating event network-changed:56378bcd-5459-47e7-8424-345fc574ebc7 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-30296833-ea9a-4de6-a070-dd2bc707dd56 req-b53e9ba1-c7d2-429b-a22a-2a70700ba3b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048634 Apr 14 11:58:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:06 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}, {"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}, {"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Creating event network-changed:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Creating event network-changed:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] Creating event network-changed:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7ef4b025-9454-46bb-815f-bc1f97d56159 req-f6cca868-4f23-4f91-a9b0-76a21eb27fc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.056609 Apr 14 11:58:06 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:06 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:08 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=14 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Creating event network-changed:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] Creating event network-changed:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-86c32987-48e2-473f-8be7-40ab53787f34 req-0b449ec8-d23f-4571-844b-79ddd81d5e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038535 Apr 14 11:58:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:08 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] Creating event network-changed:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b40d4d53-426b-4498-8885-c442245decae req-4adcdf30-88a6-41ad-ab74-15c9d23a05c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033132 Apr 14 11:58:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:10 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:10 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] Creating event network-changed:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:10 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-153cf8f9-7620-47a5-9c5a-3f591ac48916 req-60352fcb-5061-4d1f-b391-bf22d2c8b9ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039496 Apr 14 11:58:10 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:58:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] Creating event network-changed:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-ab0a2e66-8578-4713-aea4-4e9f04932334 req-0c69d867-030d-422e-848f-44051e4469cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041106 Apr 14 11:58:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:13 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-da76491e-aa02-4def-a879-85babd5e7b4e tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b" status: 200 len: 1544 microversion: 2.1 time: 0.156941 Apr 14 11:58:13 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:13 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:17 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b06ef2f13f421c967f4c86c46e5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35ab5f0a0e2453a8c5ad32e11aca784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b42ac84f-7114-4faf-9897-157ccd375b07 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 200 len: 1549 microversion: 2.1 time: 0.170763 Apr 14 11:58:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 43/128] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:17 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:18 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b28366f58e4c6b95d0f9d39ae73fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8170ca28d84853b1e641b5acbb9708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-90a2b7a5-c022-4cf8-903b-26012d88df01 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20" status: 200 len: 1523 microversion: 2.1 time: 0.270336 Apr 14 11:58:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 43/129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:18 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=11 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] Creating event network-vif-plugged:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8ff0ecf1-f443-4498-800e-024e603eda08 req-b2147e48-bc7b-4772-b4fe-b0bbb21da5d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080950 Apr 14 11:58:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] Creating event network-vif-plugged:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-c5bfef68-8e36-4a91-afae-225ecb7f5665 req-02efea51-ee76-484c-b5ac-f39f5e809bac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040093 Apr 14 11:58:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:26 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] Creating event network-vif-plugged:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e4731f43-1c01-46ae-82f3-c6d7444579d5 req-947b76a8-c9b4-491a-8f09-6153b4acf8d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045451 Apr 14 11:58:26 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "314dd23d-4b31-40a2-9a19-37613754a61b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "314dd23d-4b31-40a2-9a19-37613754a61b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "3ee869ed-353a-4e35-b0d9-57f8441c91ff"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "3ee869ed-353a-4e35-b0d9-57f8441c91ff"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:314dd23d-4b31-40a2-9a19-37613754a61b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:314dd23d-4b31-40a2-9a19-37613754a61b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] Creating event network-vif-plugged:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-51f9213e-f2ce-4e6c-9204-506b3f4dcb8c req-779b55cb-0d64-430d-8b47-4d3f56574f39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.042386 Apr 14 11:58:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=12 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:28 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=16 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Creating event network-vif-plugged:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Creating event network-vif-plugged:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] Creating event network-vif-plugged:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-5f95ecdb-c3fb-400b-b853-99634d113d23 req-babdb445-5560-4e5c-9ebc-2c92042ba0e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037590 Apr 14 11:58:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] Creating event network-vif-plugged:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-450f57a9-72c1-43c3-9679-fb00ac5431dd req-da5c1f6d-c4bb-45b0-816d-5b615e84472e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058347 Apr 14 11:58:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Creating event network-vif-plugged:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:58:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] Creating event network-vif-plugged:a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2034be59-e876-4355-8b07-a50faf47f3e9 req-e9786036-8b02-4f58-be36-75092273ffb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046100 Apr 14 11:58:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "e643b092-2a68-4a03-810c-74731525841b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "e643b092-2a68-4a03-810c-74731525841b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Creating event network-vif-plugged:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Creating event network-vif-plugged:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] Creating event network-vif-plugged:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9bc6c1a4-7bf8-4796-94e9-3f7f79e96903 req-04a58824-46b1-4c37-aec9-bb39260c7ea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067587 Apr 14 11:58:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:30 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "56378bcd-5459-47e7-8424-345fc574ebc7"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "56378bcd-5459-47e7-8424-345fc574ebc7"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:56378bcd-5459-47e7-8424-345fc574ebc7 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:56378bcd-5459-47e7-8424-345fc574ebc7 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] Creating event network-vif-plugged:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-64d69499-0dba-425f-9ca2-4c7d3055990b req-239e093d-1e4c-42fa-83dc-82ff5e7f2c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.036572 Apr 14 11:58:31 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 11:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Creating event network-vif-plugged:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Creating event network-vif-plugged:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] Creating event network-vif-plugged:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:58:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7d63a86f-ef0d-46be-b712-2ef1900d161a req-677704a1-b856-496c-966b-cbabb1ae7111 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030475 Apr 14 11:58:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:32 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=19 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:38 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-47d272cd-f5ed-447c-84ac-30925576c6a1 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1536 microversion: 2.1 time: 0.215448 Apr 14 11:58:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 47/140] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:38 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1536 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9ac8b1e2-0941-459b-90fa-767dbfd4ed98 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 200 len: 2828 microversion: 2.42 time: 0.361780 Apr 14 11:58:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 47/141] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:58:44 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 2828 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:45 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 68f7b119-b1c9-47ce-b325-5a4730aef707 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:58:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-a7d32f11-6c45-4815-beef-09c16ad094e8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707/action" status: 200 len: 32 microversion: 2.1 time: 0.258705 Apr 14 11:58:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 48/142] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:58:45 2023] POST /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-279f7284-ac90-4f68-8cba-37a8d96d7edb tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 200 len: 1510 microversion: 2.1 time: 0.257021 Apr 14 11:58:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 48/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:45 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-unplugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] Creating event network-vif-unplugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:58:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-98d8f81d-34a4-417c-a3fc-954b2bb3928a req-a37c5322-e5bc-4611-b0a3-cdbbcdc16524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049787 Apr 14 11:58:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d03b5243-1e59-49c5-8bc5-54f0fb6bb52c"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:47 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c04b8b13-835d-4a75-8164-686884093e92 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 200 len: 2823 microversion: 2.32 time: 0.597444 Apr 14 11:58:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 49/145] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:58:47 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 2823 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:58:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a3a79524-4ac9-47d0-9834-0f0929d094a8 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "POST /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889190 Apr 14 11:58:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 49/146] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:58:47 2023] POST /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad/os-volume_attachments => generated 194 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:58:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-5e738fba-6b94-4bdd-9374-94949c43ba04 req-f4c0a62a-b68b-4ab8-aa1a-fc25360376a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030869 Apr 14 11:58:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-99464054-be8e-49fc-88c0-41e2fce5dab4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.111465 Apr 14 11:58:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 50/148] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 11:58:49 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-interface => generated 282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:58:50 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}, {"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:58:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 11:58:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-83c5e675-8509-4b9c-8d8c-83adb69f4872 req-f59dd709-4675-4f8e-858d-e879dc840ad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038903 Apr 14 11:58:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 50/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] Creating event network-changed:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:58:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-16027839-2830-4fda-ad89-f19a2f8d3139 req-d2b551d4-db9a-4501-a443-ebfd03911706 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034841 Apr 14 11:58:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-606bac66-1a33-4e49-8990-de984dcc3580 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/ips" status: 200 len: 110 microversion: 2.20 time: 0.038740 Apr 14 11:58:51 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 11:58:51 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dc43631b-1c64-473d-8254-308bf5a65028 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.323233 Apr 14 11:58:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 51/152] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:58:51 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-interface => generated 283 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-47584060"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] Creating event network-changed:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 11:58:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-41e243ac-b8aa-4580-a11e-410d6f8b0a8b req-2fb225c1-ba3d-456b-ad1b-6db890ff665e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031767 Apr 14 11:58:53 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1848156407"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:53 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'flavor' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:58:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9af1dd70-70df-44f5-ba96-abf2981ba8c8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85/action" status: 202 len: 52 microversion: 2.87 time: 1.320950 Apr 14 11:58:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 51/154] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 11:58:52 2023] POST /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85/action => generated 52 bytes in 1323 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 11:58:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-030aa314-1a3f-4c17-a636-1402a3f5ff63 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action" status: 202 len: 0 microversion: 2.1 time: 0.906397 Apr 14 11:58:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 52/155] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:58:53 2023] POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 11:58:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-02afb662-3bd0-499d-967d-0664ef0213f0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '.version_select at 0x7f4371da6dd0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-02afb662-3bd0-499d-967d-0664ef0213f0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9" status: 200 len: 1611 microversion: 2.1 time: 0.053963 Apr 14 11:58:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 52/156] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 11:58:54 2023] GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9 => generated 1611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-666eacde-2340-4e83-8b07-9f6fae0890fe tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/action" status: 202 len: 0 microversion: 2.20 time: 1.074738 Apr 14 11:58:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 53/157] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 11:58:53 2023] POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/action => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:55 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:55 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a2edff9d-b897-46b1-aead-49e97c1591b0 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1713 microversion: 2.20 time: 0.194964 Apr 14 11:58:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 53/158] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:58:54 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1713 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:58:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-unplugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] Creating event network-vif-unplugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:58:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-2da5e01a-6de3-4f98-8463-fa8cbe56088f req-028211ea-7738-4f1d-a510-b295019cae49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053777 Apr 14 11:58:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:58:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-10ad8e1c-f0c3-40a3-b8c5-45fe37df88a0 req-2b24728e-0f78-4970-b3bf-37ca583d554c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069432 Apr 14 11:58:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=20 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:58:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-7e1a4baa-9ef5-4233-a46f-80cda4e5f76e tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 204 len: 0 microversion: 2.1 time: 0.170935 Apr 14 11:58:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:58:57 2023] DELETE /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:58 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31358bf3202e4dcb85df7f64c9d3c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a8d3457b646fc9085e0aac2cfda5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:58:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-642d6d7c-777e-40db-a440-12057ac9062c tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 200 len: 1541 microversion: 2.1 time: 0.275712 Apr 14 11:58:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:58:58 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 1541 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:58:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "name": "network-vif-unplugged", "status": "completed", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:58:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:58:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:58:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:58:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] Creating event network-vif-unplugged:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:58:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-5d0880c3-13e4-4e6a-8ec1-cf8d1e8d8cd9 req-6d5e977f-d759-485a-9164-dce208329714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034681 Apr 14 11:58:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 55/163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "name": "network-vif-deleted", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] Creating event network-vif-deleted:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:59:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-94b2c520-9683-4f0f-85cd-b8666e91c549 req-d0022e78-2a78-4b0a-a65f-cdbe8e51ae89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061871 Apr 14 11:59:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 55/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:00 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252824ed-0978-4f05-b03e-4d92057ce3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:00 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] Creating event network-vif-plugged:0e9eabf8-1bfa-4023-8d7a-eb3bd2d4cf9d for instance 252824ed-0978-4f05-b03e-4d92057ce3ad on user Apr 14 11:59:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-63d0484f-0d9d-4a03-bcf4-2e6a6454fb77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 200 len: 1704 microversion: 2.87 time: 0.292691 Apr 14 11:59:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2e146665-5011-4ccd-9820-833e3050af06 req-a93175cf-6a8b-4564-89b3-c9f0309ce030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Apr 14 11:59:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:00 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 1704 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:59:02 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] Creating event network-changed:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 11:59:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-ac6a8e42-8d27-4540-a8d7-59876d5a218a req-dcea123b-ea93-4063-a346-0a3e74256233 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Apr 14 11:59:02 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=18 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-996ccaa8-2951-4885-af41-35740d06c9ba tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108922 Apr 14 11:59:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:59:13 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-interface => generated 282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=18 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] Creating event network-changed:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 11:59:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6adcd2a6-fcc3-42c7-9969-bcfb3adf10f2 req-98b7e945-a28b-43d6-927b-2e01e8b3ae06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034331 Apr 14 11:59:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46ef9cc-fb22-462d-a112-baf6fd6794d4"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a0eb6bc7-0c13-43ad-bfe4-13b3c04c81ff tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.138589 Apr 14 11:59:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:59:17 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-interface => generated 283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9e78ec90-272e-47d7-bb88-501ebf7f45a6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303236 Apr 14 11:59:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:59:17 2023] POST /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-650b3119-d903-4ce4-a45f-d841d6d4114b tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103347 Apr 14 11:59:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:59:18 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] Creating event network-changed:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:59:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ca2f787e-a366-4531-838e-59a18cb913e4 req-b6c2cfe7-f1fe-4d80-8507-bc8f11aa7170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032841 Apr 14 11:59:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 58/173] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acbd4443-4921-4ac7-89aa-638371f4b639"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6155f086-ec90-4f40-8f15-33372a3e7730 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "POST /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368115 Apr 14 11:59:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 58/174] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:59:20 2023] POST /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:21 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] Creating event network-changed:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 11:59:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-e49f06f6-409c-4645-b4bf-d5192fb12f39 req-7cb38b11-7070-4df6-90e4-fad0b699465d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054227 Apr 14 11:59:21 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "987cb3c1-d233-460f-95b4-593e3c290f7d"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-45406165-1310-420f-b4de-f80450299c25 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394440 Apr 14 11:59:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 59/176] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:59:21 2023] POST /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "aa6cedd4-4ffa-4152-934e-34b4705a47af"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] HTTP exception thrown: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Request method failure captured: Apr 14 11:59:25 user devstack@n-api.service[61701]: request: PUT /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments/b46ef9cc-fb22-462d-a112-baf6fd6794d4 HTTP/1.1 Apr 14 11:59:25 user devstack@n-api.service[61701]: Accept: application/json Apr 14 11:59:25 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 11:59:25 user devstack@n-api.service[61701]: Connection: close Apr 14 11:59:25 user devstack@n-api.service[61701]: Content-Length: 74 Apr 14 11:59:25 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 11:59:25 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 11:59:25 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 11:59:25 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-aSVDRhJR5jTW_64Pd6o9d3Q7bCY6Tm6swG4FeXEsREujo922xu_HmjJxlg7T6GUdAci10V1CM35i2f7RcJZIm2ENWXZgC6SOxSNogONal5XQZOkj1P6tnvucJU8b4VfCEfMr7egaM8avNS5wx9oJ075cE27RH7O8Y08XRfQMWu8U Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Project-Id: b36f9595c1a14773877759f538608990 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesAdminNegativeTest-122603020 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Role: admin,reader,member Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Roles: admin,reader,member Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b36f9595c1a14773877759f538608990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b36f9595c1a14773877759f538608990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b36f9595c1a14773877759f538608990"}]}] Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesAdminNegativeTest-122603020 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Tenant-Id: b36f9595c1a14773877759f538608990 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-122603020 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-User: tempest-VolumesAdminNegativeTest-122603020-project-admin Apr 14 11:59:25 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 11:59:25 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 11:59:25 user devstack@n-api.service[61701]: X-User-Id: e8037cf8830b406394146e2f490a6e28 Apr 14 11:59:25 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesAdminNegativeTest-122603020-project-admin Apr 14 11:59:25 user devstack@n-api.service[61701]: Apr 14 11:59:25 user devstack@n-api.service[61701]: {"volumeAttachment": {"volumeId": "aa6cedd4-4ffa-4152-934e-34b4705a47af"}} Apr 14 11:59:25 user devstack@n-api.service[61701]: method: > Apr 14 11:59:25 user devstack@n-api.service[61701]: exception: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. Apr 14 11:59:25 user devstack@n-api.service[61701]: action_args: {'server_id': '47955121-a299-4b9b-aa83-0e55cfb52f4b', 'id': 'b46ef9cc-fb22-462d-a112-baf6fd6794d4', 'body': {'volumeAttachment': {'volumeId': 'aa6cedd4-4ffa-4152-934e-34b4705a47af'}}} Apr 14 11:59:25 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. (HTTP 404) (Request-ID: req-b208c7e3-381b-4fb9-9e7c-c10a64e38e9e) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. Apr 14 11:59:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Returning 400 to user: Volume aa6cedd4-4ffa-4152-934e-34b4705a47af could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:59:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a45d0500-daf3-42a5-b7c5-05d030e9aab4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments/b46ef9cc-fb22-462d-a112-baf6fd6794d4" status: 400 len: 107 microversion: 2.1 time: 0.406766 Apr 14 11:59:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 59/177] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 11:59:25 2023] PUT /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments/b46ef9cc-fb22-462d-a112-baf6fd6794d4 => generated 107 bytes in 408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:25 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lazy-loading 'services' on Instance uuid 47955121-a299-4b9b-aa83-0e55cfb52f4b {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:59:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-05b04787-2414-4a43-ae8e-0b3e13346981 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments/b46ef9cc-fb22-462d-a112-baf6fd6794d4" status: 202 len: 0 microversion: 2.1 time: 0.253325 Apr 14 11:59:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:59:25 2023] DELETE /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments/b46ef9cc-fb22-462d-a112-baf6fd6794d4 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9fdd8646-5b94-451a-83c2-ae8d33f72e53 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052827 Apr 14 11:59:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:25 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3518928d-9ba4-4daf-8a56-73b39a894c8c"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-eb59d329-cacb-4f26-8704-a200f36578a7 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/acbd4443-4921-4ac7-89aa-638371f4b639" status: 202 len: 0 microversion: 2.1 time: 0.358706 Apr 14 11:59:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 11:59:28 2023] PUT /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/acbd4443-4921-4ac7-89aa-638371f4b639 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-66028350-156e-4936-9967-9435ac20f97f tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 Apr 14 11:59:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:29 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:29 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lazy-loading 'services' on Instance uuid 8c623c90-6b65-4de1-a67a-c7f667aa2d8d {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:59:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-1c1c38d6-8ed3-4177-96a8-ed1659e1c209 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments/987cb3c1-d233-460f-95b4-593e3c290f7d" status: 202 len: 0 microversion: 2.1 time: 0.250881 Apr 14 11:59:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:59:29 2023] DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments/987cb3c1-d233-460f-95b4-593e3c290f7d => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6cacf7a0-90f7-4452-9e80-a32af6dea0d0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044915 Apr 14 11:59:31 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:31 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3d6760da-bf8a-4cd4-82c1-0c585d9c0baa tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040041 Apr 14 11:59:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:32 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:59:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9b2028a0-c967-4830-8ac2-687851842c80 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 204 len: 0 microversion: 2.1 time: 0.126221 Apr 14 11:59:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:59:32 2023] DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b06ef2f13f421c967f4c86c46e5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35ab5f0a0e2453a8c5ad32e11aca784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c7bf3872-472c-4c80-a38a-bfbb13ec86d8 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 200 len: 1674 microversion: 2.1 time: 0.186187 Apr 14 11:59:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:32 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "name": "network-vif-unplugged", "status": "completed", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] Creating event network-vif-unplugged:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:59:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f167300b-4b7f-4a1b-bbbf-6494d08e7810 req-dbdf0b42-998e-47b9-9a6d-d0dfaf598785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032439 Apr 14 11:59:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "name": "network-vif-deleted", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] Creating event network-vif-deleted:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:59:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-62c951ac-ae84-47eb-af1f-ef308c540562 req-6675697f-11fe-40a9-8af1-2c2d7432fe62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055106 Apr 14 11:59:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c623c90-6b65-4de1-a67a-c7f667aa2d8d", "name": "network-vif-plugged", "status": "completed", "tag": "4a2c37e2-c105-4bee-940b-19f8974cd14b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] Creating event network-vif-plugged:4a2c37e2-c105-4bee-940b-19f8974cd14b for instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d on user Apr 14 11:59:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-d88cfd62-6ab5-42f5-a47c-ef2b530f2771 req-781db138-3c03-4672-a17e-dde0f202fcf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047865 Apr 14 11:59:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 63/189] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:36 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2fd462b0-cb86-4789-8d2c-3abf54f85e61 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 200 len: 1490 microversion: 2.1 time: 0.261836 Apr 14 11:59:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:36 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 1490 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:38 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-71e84a81-7c13-4787-bc39-fa032c7ea630 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1536 microversion: 2.1 time: 0.169435 Apr 14 11:59:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:38 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1536 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Searching by: {'deleted': False, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9'} {{(pid=61701) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:38 user devstack@n-api.service[61701]: DEBUG nova.compute.multi_cell_list [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 11:59:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6d944f1b-a8ad-4272-9cb1-b289f46ff7ac tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.194125 Apr 14 11:59:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 11:59:38 2023] GET /compute/v2.1/servers => generated 341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:39 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c9b8e4d0-ef59-4b59-8f01-750e003c2f07 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1536 microversion: 2.1 time: 0.133760 Apr 14 11:59:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:39 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1536 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c0786fe5-911e-4933-bebc-1405a916d416 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059392 Apr 14 11:59:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:40 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-32365345-469b-411b-9f1c-24c78a2377b1 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Apr 14 11:59:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 65/195] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:40 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "acbd4443-4921-4ac7-89aa-638371f4b639"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9bc9ab10-2341-4f6c-b389-893ad3530668 tempest-TestVolumeSwap-26184589 tempest-TestVolumeSwap-26184589-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/3518928d-9ba4-4daf-8a56-73b39a894c8c" status: 202 len: 0 microversion: 2.1 time: 0.318612 Apr 14 11:59:40 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 66/196] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 11:59:40 2023] PUT /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/3518928d-9ba4-4daf-8a56-73b39a894c8c => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02f6321c-fa2b-4e36-8b89-caffe1df4027"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-de0daf7d-cd5b-48b8-bd11-a85db98031f4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386791 Apr 14 11:59:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 66/197] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:59:41 2023] POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-bb4c3d89-65a7-4910-86e9-a2a3bdea4d94 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '.version_select at 0x7f4371c40160>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-bb4c3d89-65a7-4910-86e9-a2a3bdea4d94 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9" status: 200 len: 1725 microversion: 2.1 time: 0.052499 Apr 14 11:59:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 11:59:44 2023] GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9 => generated 1725 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e7b0e10c-02ed-464e-a843-72c392ce06ad tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '.version_select at 0x7f4371dd3be0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e7b0e10c-02ed-464e-a843-72c392ce06ad tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9" status: 200 len: 1725 microversion: 2.1 time: 0.049707 Apr 14 11:59:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 11:59:44 2023] GET /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9 => generated 1725 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:44 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-de402b89-a68f-428d-84f2-ffb506b535f7 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1672 microversion: 2.1 time: 0.151940 Apr 14 11:59:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:44 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-61c701f6-2e51-4b93-84ec-67b2e60052d3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1654 microversion: 2.20 time: 0.170250 Apr 14 11:59:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 67/201] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:45 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=21 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-76e4e17f-39ea-41d0-8f94-b24040597a60 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.127627 Apr 14 11:59:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 68/202] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 11:59:45 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639/os-interface => generated 1827 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] Creating event network-changed:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ed40b57f-b250-4192-bcbd-74e2d7360024 req-a6dce093-3ec4-4f45-8058-108dfa7e6c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033863 Apr 14 11:59:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:46 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4a904f0c-39fb-46e9-9d30-f3c3033824fc tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 200 len: 2828 microversion: 2.42 time: 0.301234 Apr 14 11:59:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 68/204] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:46 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 2828 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f2978bcd-cc0a-4030-bd27-0838869313f6 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.120941 Apr 14 11:59:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 69/205] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 11:59:46 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639/os-interface => generated 1827 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-681893e6-2e90-4423-8b49-f2280bc0767f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.194638 Apr 14 11:59:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 69/206] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 11:59:47 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5/os-interface => generated 1830 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=23 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] HTTP exception thrown: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Request method failure captured: Apr 14 11:59:48 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad HTTP/1.1 Apr 14 11:59:48 user devstack@n-api.service[61699]: Accept: application/json Apr 14 11:59:48 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 11:59:48 user devstack@n-api.service[61699]: Connection: close Apr 14 11:59:48 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 11:59:48 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 11:59:48 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 11:59:48 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 11:59:48 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-Cu8OnK79oYnmeZUbJE2m2C9P0FQl5Hh1ba-b4X-QaYKLljWAfXWootpNWwrOpKwQlpk23AOvsruNVDt2VyyWvhjcCm5tP9YgvTpAWPY_BJug5fJq2rndLP8hFMiPZIc88ZRxufRfwzr3eOIYWm2PAJ73UTXy6IGjt_87kUHQt6IE Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/186a8d3457b646fc9085e0aac2cfda5b"}]}] Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Id: 31358bf3202e4dcb85df7f64c9d3c1d0 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Name: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:48 user devstack@n-api.service[61699]: method: > Apr 14 11:59:48 user devstack@n-api.service[61699]: exception: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: action_args: {'id': '252824ed-0978-4f05-b03e-4d92057ce3ad'} Apr 14 11:59:48 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Returning 404 to user: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:59:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2a228ff6-f69f-4b36-b1c2-ebcdae20383a tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 404 len: 111 microversion: 2.1 time: 0.042846 Apr 14 11:59:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:48 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:59:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:59:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f2b0442e-226a-4a28-a636-01cf9d8913ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 204 len: 0 microversion: 2.42 time: 0.204668 Apr 14 11:59:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 69/208] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:59:48 2023] DELETE /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] HTTP exception thrown: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Request method failure captured: Apr 14 11:59:48 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad/os-volume_attachments HTTP/1.1 Apr 14 11:59:48 user devstack@n-api.service[61699]: Accept: application/json Apr 14 11:59:48 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 11:59:48 user devstack@n-api.service[61699]: Connection: close Apr 14 11:59:48 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 11:59:48 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 11:59:48 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 11:59:48 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 11:59:48 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-Cu8OnK79oYnmeZUbJE2m2C9P0FQl5Hh1ba-b4X-QaYKLljWAfXWootpNWwrOpKwQlpk23AOvsruNVDt2VyyWvhjcCm5tP9YgvTpAWPY_BJug5fJq2rndLP8hFMiPZIc88ZRxufRfwzr3eOIYWm2PAJ73UTXy6IGjt_87kUHQt6IE Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Project-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/186a8d3457b646fc9085e0aac2cfda5b"}]}] Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:48 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Id: 31358bf3202e4dcb85df7f64c9d3c1d0 Apr 14 11:59:48 user devstack@n-api.service[61699]: X-User-Name: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:48 user devstack@n-api.service[61699]: method: > Apr 14 11:59:48 user devstack@n-api.service[61699]: exception: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: action_args: {'server_id': '252824ed-0978-4f05-b03e-4d92057ce3ad'} Apr 14 11:59:48 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 11:59:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Returning 404 to user: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:59:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e91f3af0-2bf6-4268-8a1a-fa4f916cc7c1 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047192 Apr 14 11:59:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:48 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07e15f00ba92432e9c4a222e1b40c9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aedc5467e84f3788269d2f35ff4cb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-eb1502af-0ae9-469c-8077-be0a52db7078 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 200 len: 2952 microversion: 2.42 time: 0.627938 Apr 14 11:59:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 70/210] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:48 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 2952 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] Creating event network-vif-unplugged:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-62232656-f701-4401-912a-9c5bbaffec07 req-2a150a7e-bb35-4a68-aba1-314f187559e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058900 Apr 14 11:59:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 70/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] Creating event network-vif-unplugged:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-545dda8a-38f8-4a5c-abbe-bb7e9e2a9128 req-5f0f517d-4485-46e9-8377-786db40f860f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083338 Apr 14 11:59:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] Creating event network-vif-unplugged:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-97b392c8-d56e-46c1-aeeb-bfd1da71b390 req-4e1f97f0-3bdc-40a5-a720-4ffa2c8a5ac4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081204 Apr 14 11:59:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:50 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:50 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:50 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2e3bd11c-9cf3-41b6-8161-ff890ede5cea tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 200 len: 2823 microversion: 2.32 time: 0.573965 Apr 14 11:59:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 71/214] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:49 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 2823 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8d6a7299-98f6-4318-9795-282221c21e4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.294899 Apr 14 11:59:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 73/215] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 11:59:50 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5/os-interface => generated 1830 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-050e6067-860b-47c2-9660-9a90001c8ed7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 200 len: 1691 microversion: 2.87 time: 0.460931 Apr 14 11:59:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:50 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 1691 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 11:59:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] Creating event network-vif-plugged:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-c6d243d5-0ba6-42f5-89a7-60db11a3c4c8 req-8f495cdc-bc52-4275-94ad-d4aa3c0c7517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039406 Apr 14 11:59:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:51 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "tag": "e643b092-2a68-4a03-810c-74731525841b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "314dd23d-4b31-40a2-9a19-37613754a61b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "314dd23d-4b31-40a2-9a19-37613754a61b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "3ee869ed-353a-4e35-b0d9-57f8441c91ff"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "3ee869ed-353a-4e35-b0d9-57f8441c91ff"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-changed:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-plugged:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-unplugged:314dd23d-4b31-40a2-9a19-37613754a61b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-plugged:314dd23d-4b31-40a2-9a19-37613754a61b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-unplugged:3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-plugged:3ee869ed-353a-4e35-b0d9-57f8441c91ff for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] Creating event network-vif-unplugged:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6f758ded-653d-485b-9505-7332f0fba6c3 req-e251049d-0ccb-487a-9cea-99def37e3729 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.045615 Apr 14 11:59:51 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 74/218] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 11:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-unplugged", "status": "completed", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Creating event network-vif-plugged:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Creating event network-vif-unplugged:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] Creating event network-vif-plugged:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-cd6d23b1-43b1-4b92-bbac-ac9792817314 req-b563852f-33be-4ad1-9ce4-ea466ea1971f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.059412 Apr 14 11:59:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 73/219] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:59:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a53a913c-efcc-4fc0-8e64-a8b351146060 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 204 len: 0 microversion: 2.32 time: 0.129480 Apr 14 11:59:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 73/220] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:59:52 2023] DELETE /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0497d49f8544fe6b28101364faaadd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62161098b7244829bdeba1cfd1d6b970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-86a9da08-0d80-46e1-803d-2e631d321a95 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 200 len: 2829 microversion: 2.32 time: 0.325986 Apr 14 11:59:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 75/221] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:59:52 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 2829 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] HTTP exception thrown: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Request method failure captured: Apr 14 11:59:53 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad HTTP/1.1 Apr 14 11:59:53 user devstack@n-api.service[61700]: Accept: application/json Apr 14 11:59:53 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 11:59:53 user devstack@n-api.service[61700]: Connection: close Apr 14 11:59:53 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 11:59:53 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 11:59:53 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 11:59:53 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 11:59:53 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-Cu8OnK79oYnmeZUbJE2m2C9P0FQl5Hh1ba-b4X-QaYKLljWAfXWootpNWwrOpKwQlpk23AOvsruNVDt2VyyWvhjcCm5tP9YgvTpAWPY_BJug5fJq2rndLP8hFMiPZIc88ZRxufRfwzr3eOIYWm2PAJ73UTXy6IGjt_87kUHQt6IE Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Project-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Project-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/186a8d3457b646fc9085e0aac2cfda5b"}]}] Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Tenant: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Tenant-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:53 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61700]: X-User: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:53 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 11:59:53 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 11:59:53 user devstack@n-api.service[61700]: X-User-Id: 31358bf3202e4dcb85df7f64c9d3c1d0 Apr 14 11:59:53 user devstack@n-api.service[61700]: X-User-Name: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:53 user devstack@n-api.service[61700]: method: > Apr 14 11:59:53 user devstack@n-api.service[61700]: exception: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61700]: action_args: {'id': '252824ed-0978-4f05-b03e-4d92057ce3ad'} Apr 14 11:59:53 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Returning 404 to user: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:59:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5f775d2b-b5a0-4131-a1d7-47ffadeba67f tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 404 len: 111 microversion: 2.1 time: 0.055296 Apr 14 11:59:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 74/222] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:59:53 2023] DELETE /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] [instance: 252824ed-0978-4f05-b03e-4d92057ce3ad] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] HTTP exception thrown: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Request method failure captured: Apr 14 11:59:53 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad HTTP/1.1 Apr 14 11:59:53 user devstack@n-api.service[61701]: Accept: application/json Apr 14 11:59:53 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 11:59:53 user devstack@n-api.service[61701]: Connection: close Apr 14 11:59:53 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 11:59:53 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 11:59:53 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 11:59:53 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 11:59:53 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-Cu8OnK79oYnmeZUbJE2m2C9P0FQl5Hh1ba-b4X-QaYKLljWAfXWootpNWwrOpKwQlpk23AOvsruNVDt2VyyWvhjcCm5tP9YgvTpAWPY_BJug5fJq2rndLP8hFMiPZIc88ZRxufRfwzr3eOIYWm2PAJ73UTXy6IGjt_87kUHQt6IE Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Project-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Project-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/186a8d3457b646fc9085e0aac2cfda5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/186a8d3457b646fc9085e0aac2cfda5b"}]}] Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Tenant: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Tenant-Id: 186a8d3457b646fc9085e0aac2cfda5b Apr 14 11:59:53 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-DeleteServersTestJSON-232033621 Apr 14 11:59:53 user devstack@n-api.service[61701]: X-User: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:53 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 11:59:53 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 11:59:53 user devstack@n-api.service[61701]: X-User-Id: 31358bf3202e4dcb85df7f64c9d3c1d0 Apr 14 11:59:53 user devstack@n-api.service[61701]: X-User-Name: tempest-DeleteServersTestJSON-232033621-project-member Apr 14 11:59:53 user devstack@n-api.service[61701]: method: > Apr 14 11:59:53 user devstack@n-api.service[61701]: exception: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61701]: action_args: {'id': '252824ed-0978-4f05-b03e-4d92057ce3ad'} Apr 14 11:59:53 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. Apr 14 11:59:53 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 11:59:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] Returning 404 to user: Instance 252824ed-0978-4f05-b03e-4d92057ce3ad could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:59:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c1556049-e12a-4deb-a484-de64f6e13ad3 tempest-DeleteServersTestJSON-232033621 tempest-DeleteServersTestJSON-232033621-project-member] 10.0.0.210 "GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad" status: 404 len: 111 microversion: 2.1 time: 0.065129 Apr 14 11:59:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:53 2023] GET /compute/v2.1/servers/252824ed-0978-4f05-b03e-4d92057ce3ad => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:59:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-plugged", "status": "completed", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "56378bcd-5459-47e7-8424-345fc574ebc7"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Creating event network-vif-plugged:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Creating event network-vif-unplugged:a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Creating event network-vif-plugged:a78f67d0-ec96-4686-b3fd-5cf2bf5b5d79 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] Creating event network-vif-unplugged:56378bcd-5459-47e7-8424-345fc574ebc7 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-97d4daf3-81ee-460b-8022-729a58be86dd req-7ac6ce7c-5ea2-4ed3-ba7c-2ad1aae79339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.050181 Apr 14 11:59:53 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:53 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "e643b092-2a68-4a03-810c-74731525841b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "e643b092-2a68-4a03-810c-74731525841b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Creating event network-vif-unplugged:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Creating event network-vif-plugged:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Creating event network-vif-unplugged:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Creating event network-vif-plugged:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] Creating event network-vif-unplugged:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-5a54795e-cb67-4381-871a-c9f1a6237174 req-57a9428f-3d96-43b3-b61e-7208ab424276 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 873 microversion: 2.1 time: 0.103375 Apr 14 11:59:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 75/225] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 873 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:59:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6e168ff5-ebb5-47e8-aa48-b682b5755b9a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1582 microversion: 2.1 time: 0.331207 Apr 14 11:59:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:59:54 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1582 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-de06e179-7dcb-4be1-92e3-60973231dddd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Apr 14 11:59:55 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:55 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-323524ed-d935-47cb-a52c-b5ae42046e60 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065926 Apr 14 11:59:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:55 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lazy-loading 'services' on Instance uuid 34c3100c-5b90-47a1-8c3b-fb53467fcd20 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:59:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1cc25eee-d0a1-4bb0-bc44-a9593f3d9cd9 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/acbd4443-4921-4ac7-89aa-638371f4b639" status: 202 len: 0 microversion: 2.1 time: 0.285805 Apr 14 11:59:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:59:55 2023] DELETE /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments/acbd4443-4921-4ac7-89aa-638371f4b639 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c707cdc6-a327-48d1-b5f7-44906677b9d4 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083529 Apr 14 11:59:55 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:59:55 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "56378bcd-5459-47e7-8424-345fc574ebc7"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-unplugged", "status": "completed", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Creating event network-vif-plugged:56378bcd-5459-47e7-8424-345fc574ebc7 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Creating event network-vif-unplugged:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Creating event network-vif-plugged:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Creating event network-vif-unplugged:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] Creating event network-vif-plugged:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:56 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-1b25512e-0e15-49a7-8669-e1799a5ec8cb req-a3a8b2ac-e1f1-41ed-94a6-8321e2fd01cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.055920 Apr 14 11:59:56 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 77/231] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:55 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:56 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-plugged", "status": "completed", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] Creating event network-vif-plugged:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 11:59:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-962bb724-4e06-4ba0-ae02-21c6a58ef47b req-24bd9bc5-b352-4404-bf94-8d28031b5715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049698 Apr 14 11:59:56 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 77/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-deleted", "tag": "1dc3ed86-ee69-4541-a687-409bb40f1966"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] Creating event network-vif-deleted:1dc3ed86-ee69-4541-a687-409bb40f1966 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 11:59:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-13e8ca85-c9d8-462b-84c4-1051a94b94dd req-2a146edd-6eff-4668-8514-0b1d6c911af6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036381 Apr 14 11:59:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 79/233] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] Creating event network-changed:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 11:59:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b200862c-b5b6-4aae-a1a9-303b7674c2be req-a8277020-4857-4c31-9760-b418f126543a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Apr 14 11:59:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 78/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-836687135"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:59:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:59:58 user devstack@n-api.service[61701]: INFO nova.network.security_group_api [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Adding security group 23ebe7d9-0021-4e72-aa3c-c364203bf498 to port 1aad7982-a338-4425-9e53-ea99f31b0de6 Apr 14 12:00:00 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-deleted", "tag": "6ea5022d-9892-4cd9-90a9-4328326b209d"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-deleted", "tag": "27a86908-d21f-46e8-a84d-66b055203f9b"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-deleted", "tag": "18a26f8b-649d-4f0f-865f-cea6cd23372b"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-deleted", "tag": "737a9bf4-c102-475e-b791-c56b01f23d0d"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Creating event network-vif-deleted:6ea5022d-9892-4cd9-90a9-4328326b209d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 12:00:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Creating event network-vif-deleted:27a86908-d21f-46e8-a84d-66b055203f9b for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 12:00:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Creating event network-vif-deleted:18a26f8b-649d-4f0f-865f-cea6cd23372b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 12:00:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] Creating event network-vif-deleted:737a9bf4-c102-475e-b791-c56b01f23d0d for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 12:00:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-d1bb8431-67da-4b71-af35-339f74848794 req-2efc42d0-a23c-49b4-947c-be29eeec8c4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034925 Apr 14 12:00:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 80/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dd705a5d-8e26-4134-97b3-ace81dcab403 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action" status: 202 len: 0 microversion: 2.1 time: 1.591726 Apr 14 12:00:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 78/236] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:59:58 2023] POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:00 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-00153e5d-f513-46e2-b16a-c909137bde7f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1747 microversion: 2.1 time: 0.196453 Apr 14 12:00:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:00 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1747 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}, {"server_uuid": "b97d3633-4864-45fa-8d87-968507e13639", "name": "network-vif-deleted", "tag": "b786ac42-d885-4cbb-a03c-5d7c17adfae2"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-deleted", "tag": "8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-deleted", "tag": "9f35f7af-3587-48b6-9ee5-05dd1fdb00a4"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-deleted", "tag": "7fc577b9-cdea-45d8-9e73-a5cae3b67eec"}, {"server_uuid": "132e2ee3-a757-42ef-b0ae-3441dca65da5", "name": "network-vif-deleted", "tag": "e643b092-2a68-4a03-810c-74731525841b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-changed:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-vif-deleted:b786ac42-d885-4cbb-a03c-5d7c17adfae2 for instance b97d3633-4864-45fa-8d87-968507e13639 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-vif-deleted:8ab64dc7-8b90-4ef2-8860-6c0ce50d24ab for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-vif-deleted:9f35f7af-3587-48b6-9ee5-05dd1fdb00a4 for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-vif-deleted:7fc577b9-cdea-45d8-9e73-a5cae3b67eec for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] Creating event network-vif-deleted:e643b092-2a68-4a03-810c-74731525841b for instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 on user Apr 14 12:00:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-07be7bfa-498b-4022-b15e-aa205907e2dc req-946a590e-e76b-437a-a649-173b5ac573d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1034 microversion: 2.1 time: 0.044160 Apr 14 12:00:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 81/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 1034 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b221a8a1-3491-4cb1-9efa-03c6c2ce8383 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action" status: 202 len: 0 microversion: 2.1 time: 0.093502 Apr 14 12:00:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 79/239] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:00:03 2023] POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:04 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c3889fd2-2845-4d7c-80d5-16189640a101 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1749 microversion: 2.1 time: 0.208185 Apr 14 12:00:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 80/240] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:04 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1749 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:05 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-unplugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:05 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] Creating event network-vif-unplugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:00:05 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8c09e42f-63eb-4bf4-b14e-ed8f0dd345de req-35cee55f-ab01-430c-90d5-ef0805ae1561 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041004 Apr 14 12:00:05 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:00:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4491eb49-1763-459f-9926-280f1c30fdae req-71e221fd-13b7-4b34-94cc-31d4d3698293 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049735 Apr 14 12:00:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 80/242] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:00:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b799e31c-6c58-4219-bf26-95a0c4bf643e req-8d56296d-ccce-48c8-9ae5-dbee63d08099 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035095 Apr 14 12:00:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 81/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:11 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:00:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6b28d7b6-f2e9-4bfb-9881-788ab7acc555 req-86e01b0b-fe58-412f-b261-5c9d1939b4ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030534 Apr 14 12:00:11 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 83/244] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f947cf88-c087-4716-9ca4-4473150939cb tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051698 Apr 14 12:00:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 81/245] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:00:16 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1095164094", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "19680b33-4490-481b-8566-09234e2ffa89"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=32 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] validate_networks() for [('19680b33-4490-481b-8566-09234e2ffa89', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=56 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Getting quotas for user 390ba60eb6f3478fb8225976ee516218 and project 8d1dde7a2b6d498cbb829c51bfafadee. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:00:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:00:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3f4fd68e-f26a-4fa2-bb56-bba052c3452a tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.503832 Apr 14 12:00:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 82/246] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:00:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:00:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-32d051fb-bd62-444f-b382-7bf9528f4f76 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-32d051fb-bd62-444f-b382-7bf9528f4f76 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:16 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=32 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:16 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-32d051fb-bd62-444f-b382-7bf9528f4f76 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-32d051fb-bd62-444f-b382-7bf9528f4f76 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" status: 200 len: 1212 microversion: 2.1 time: 0.082950 Apr 14 12:00:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:16 2023] GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] Creating event network-changed:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:00:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-23577bd0-0cb1-485f-a3ea-91a18e7558c4 req-a225b835-7e81-44a9-8242-fba934276b2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 Apr 14 12:00:19 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:00:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "name": "network-vif-plugged", "status": "completed", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] Creating event network-vif-plugged:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:00:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-8ba61e33-d6da-4d1f-93fc-896788663225 req-ec2482f9-f333-4e52-871d-f3784e37c7e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Apr 14 12:00:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 83/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=39 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:22 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] HTTP exception thrown: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Request method failure captured: Apr 14 12:00:22 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d HTTP/1.1 Apr 14 12:00:22 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:00:22 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:00:22 user devstack@n-api.service[61699]: Connection: close Apr 14 12:00:22 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:00:22 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:00:22 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:00:22 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:00:22 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT97gMdvjfm6snpEL2G9SXiLJPL1mWvsmsUwgcYnYgx9gKf1B-Yxv2lLRmVkda5cqvm91b57Qu5YoZCAguYTwfY3cmLbsuI8u_Cp0y3fQYP7ybAlrhdjd-eu8Okg3O2czmQOegvKTqUMhqUac93m_thYE2W2CBdzHcNtQYJBwO_H1Go Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Project-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f35ab5f0a0e2453a8c5ad32e11aca784"}]}] Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Tenant-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-User: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:22 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:00:22 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:00:22 user devstack@n-api.service[61699]: X-User-Id: 30b06ef2f13f421c967f4c86c46e5293 Apr 14 12:00:22 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:22 user devstack@n-api.service[61699]: method: > Apr 14 12:00:22 user devstack@n-api.service[61699]: exception: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:22 user devstack@n-api.service[61699]: action_args: {'id': '8c623c90-6b65-4de1-a67a-c7f667aa2d8d'} Apr 14 12:00:22 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:22 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Returning 404 to user: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:22 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e2b3fcf2-27ba-4ceb-9e85-2aabff2577ad tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 404 len: 111 microversion: 2.1 time: 0.102558 Apr 14 12:00:22 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:22 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:00:22 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c0d1e11f-3148-4a94-b1f5-1fcd4038d3ee tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '.version_select at 0x7f4371829bd0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c0d1e11f-3148-4a94-b1f5-1fcd4038d3ee tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553945765" status: 202 len: 0 microversion: 2.1 time: 0.027022 Apr 14 12:00:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:00:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553945765 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:00:23 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "name": "network-vif-plugged", "status": "completed", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:23 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] Creating event network-vif-plugged:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:00:23 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-31c764fa-8990-4a5a-b727-3f2464e8bd5e req-b482f1c1-4f2a-4394-9ce8-2d87bc22fe77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Apr 14 12:00:23 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] HTTP exception thrown: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Request method failure captured: Apr 14 12:00:27 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d HTTP/1.1 Apr 14 12:00:27 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:00:27 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:00:27 user devstack@n-api.service[61699]: Connection: close Apr 14 12:00:27 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:00:27 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:00:27 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:00:27 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:00:27 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT97gMdvjfm6snpEL2G9SXiLJPL1mWvsmsUwgcYnYgx9gKf1B-Yxv2lLRmVkda5cqvm91b57Qu5YoZCAguYTwfY3cmLbsuI8u_Cp0y3fQYP7ybAlrhdjd-eu8Okg3O2czmQOegvKTqUMhqUac93m_thYE2W2CBdzHcNtQYJBwO_H1Go Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Project-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f35ab5f0a0e2453a8c5ad32e11aca784"}]}] Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Tenant-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-User: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:27 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:00:27 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:00:27 user devstack@n-api.service[61699]: X-User-Id: 30b06ef2f13f421c967f4c86c46e5293 Apr 14 12:00:27 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:27 user devstack@n-api.service[61699]: method: > Apr 14 12:00:27 user devstack@n-api.service[61699]: exception: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61699]: action_args: {'id': '8c623c90-6b65-4de1-a67a-c7f667aa2d8d'} Apr 14 12:00:27 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Returning 404 to user: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-a10642ab-335c-4cd3-8025-14a51b763fd0 tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 404 len: 111 microversion: 2.1 time: 0.047418 Apr 14 12:00:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:00:27 2023] DELETE /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] [instance: 8c623c90-6b65-4de1-a67a-c7f667aa2d8d] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] HTTP exception thrown: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Request method failure captured: Apr 14 12:00:27 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d HTTP/1.1 Apr 14 12:00:27 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:00:27 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:00:27 user devstack@n-api.service[61701]: Connection: close Apr 14 12:00:27 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:00:27 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:00:27 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:00:27 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:00:27 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT97gMdvjfm6snpEL2G9SXiLJPL1mWvsmsUwgcYnYgx9gKf1B-Yxv2lLRmVkda5cqvm91b57Qu5YoZCAguYTwfY3cmLbsuI8u_Cp0y3fQYP7ybAlrhdjd-eu8Okg3O2czmQOegvKTqUMhqUac93m_thYE2W2CBdzHcNtQYJBwO_H1Go Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Project-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f35ab5f0a0e2453a8c5ad32e11aca784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f35ab5f0a0e2453a8c5ad32e11aca784"}]}] Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Tenant-Id: f35ab5f0a0e2453a8c5ad32e11aca784 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-291907837 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-User: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:27 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:00:27 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:00:27 user devstack@n-api.service[61701]: X-User-Id: 30b06ef2f13f421c967f4c86c46e5293 Apr 14 12:00:27 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-291907837-project-member Apr 14 12:00:27 user devstack@n-api.service[61701]: method: > Apr 14 12:00:27 user devstack@n-api.service[61701]: exception: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61701]: action_args: {'id': '8c623c90-6b65-4de1-a67a-c7f667aa2d8d'} Apr 14 12:00:27 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. Apr 14 12:00:27 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] Returning 404 to user: Instance 8c623c90-6b65-4de1-a67a-c7f667aa2d8d could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-290c8f98-d0df-4e41-a1d0-ac6490b502cf tempest-AttachSCSIVolumeTestJSON-291907837 tempest-AttachSCSIVolumeTestJSON-291907837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d" status: 404 len: 111 microversion: 2.1 time: 0.035367 Apr 14 12:00:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:27 2023] GET /compute/v2.1/servers/8c623c90-6b65-4de1-a67a-c7f667aa2d8d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=5 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:36 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ae71556f-3218-4724-9ebb-715926c98e49 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1504 microversion: 2.1 time: 0.265548 Apr 14 12:00:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:36 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=7 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HTTP exception thrown: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Request method failure captured: Apr 14 12:00:39 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 HTTP/1.1 Apr 14 12:00:39 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:00:39 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:00:39 user devstack@n-api.service[61699]: Connection: close Apr 14 12:00:39 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:00:39 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:00:39 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:00:39 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:00:39 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT96U4F7y4fJJC0kN3jE4OxzPi74XzpO_Uk1dHsvKR22ph2Y4UwhrjIoyKP34DY09rzITPJd_e5QuH3OxQjxmh7GIZXuYvNzsMB2kdBt9McwyQJSTpYoXHhacH9iEO7ypHCFPuOpMDCEqMMWSKlkwqtTqkrIXYFA1VPzDUZ_bEt1dQI Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Project-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01aedc5467e84f3788269d2f35ff4cb0"}]}] Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Tenant-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:39 user devstack@n-api.service[61699]: X-User: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:39 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:00:39 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:00:39 user devstack@n-api.service[61699]: X-User-Id: 07e15f00ba92432e9c4a222e1b40c9ab Apr 14 12:00:39 user devstack@n-api.service[61699]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:39 user devstack@n-api.service[61699]: method: > Apr 14 12:00:39 user devstack@n-api.service[61699]: exception: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:39 user devstack@n-api.service[61699]: action_args: {'id': 'b97d3633-4864-45fa-8d87-968507e13639'} Apr 14 12:00:39 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Returning 404 to user: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-074d835c-d8a3-4cb5-9614-7442062433ee tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 404 len: 111 microversion: 2.42 time: 0.033456 Apr 14 12:00:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 87/256] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:39 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dbe4ffeb-675f-4703-929e-1b857273213a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '.version_select at 0x7f4371b19000>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:39 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:39 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:00:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dbe4ffeb-675f-4703-929e-1b857273213a tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582248460" status: 204 len: 0 microversion: 2.42 time: 0.024557 Apr 14 12:00:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 85/257] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 12:00:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1582248460 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HTTP exception thrown: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Request method failure captured: Apr 14 12:00:42 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 HTTP/1.1 Apr 14 12:00:42 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:00:42 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:00:42 user devstack@n-api.service[61699]: Connection: close Apr 14 12:00:42 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:00:42 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:00:42 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:00:42 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:00:42 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT96U4F7y4fJJC0kN3jE4OxzPi74XzpO_Uk1dHsvKR22ph2Y4UwhrjIoyKP34DY09rzITPJd_e5QuH3OxQjxmh7GIZXuYvNzsMB2kdBt9McwyQJSTpYoXHhacH9iEO7ypHCFPuOpMDCEqMMWSKlkwqtTqkrIXYFA1VPzDUZ_bEt1dQI Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Project-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01aedc5467e84f3788269d2f35ff4cb0"}]}] Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Tenant-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61699]: X-User: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:42 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61699]: X-User-Id: 07e15f00ba92432e9c4a222e1b40c9ab Apr 14 12:00:42 user devstack@n-api.service[61699]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:42 user devstack@n-api.service[61699]: method: > Apr 14 12:00:42 user devstack@n-api.service[61699]: exception: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61699]: action_args: {'id': 'b97d3633-4864-45fa-8d87-968507e13639'} Apr 14 12:00:42 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Returning 404 to user: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d1aec0f9-f806-4e50-b09a-2cd226075204 tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 404 len: 111 microversion: 2.42 time: 0.032412 Apr 14 12:00:42 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:00:42 2023] DELETE /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HTTP exception thrown: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Request method failure captured: Apr 14 12:00:42 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 HTTP/1.1 Apr 14 12:00:42 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:00:42 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:00:42 user devstack@n-api.service[61700]: Connection: close Apr 14 12:00:42 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:00:42 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:00:42 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:00:42 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:00:42 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-FcsCmUOMrVAJari3xAktI2Z1lI9JvHn6_09G13PWZyzbZJ4ZEdXhTNO9VlVQx2MwUdEMUHcRtm8rHBoY0ekKLBhhrYLS0LaM6eF0CAQpmimE_Snq758oSv_8IzMuxcBGcuWdoj-gFPZCRXawPYbsAyne1lV3wK9IBzXQ5IDsmNws Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Project-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Project-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62161098b7244829bdeba1cfd1d6b970"}]}] Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Tenant: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Tenant-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-User: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:42 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61700]: X-User-Id: e0497d49f8544fe6b28101364faaadd7 Apr 14 12:00:42 user devstack@n-api.service[61700]: X-User-Name: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:42 user devstack@n-api.service[61700]: method: > Apr 14 12:00:42 user devstack@n-api.service[61700]: exception: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61700]: action_args: {'id': '132e2ee3-a757-42ef-b0ae-3441dca65da5'} Apr 14 12:00:42 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Returning 404 to user: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-4f148abc-06d7-4c62-82ab-a6eae38ebc4c tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 404 len: 111 microversion: 2.32 time: 0.039284 Apr 14 12:00:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 86/259] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:42 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] [instance: b97d3633-4864-45fa-8d87-968507e13639] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f3089a7a-508a-4f53-94af-e78f654f3db4 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '.version_select at 0x7f4371aeac20>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] HTTP exception thrown: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Request method failure captured: Apr 14 12:00:42 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 HTTP/1.1 Apr 14 12:00:42 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:00:42 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:00:42 user devstack@n-api.service[61701]: Connection: close Apr 14 12:00:42 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:00:42 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:00:42 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:00:42 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:00:42 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT96U4F7y4fJJC0kN3jE4OxzPi74XzpO_Uk1dHsvKR22ph2Y4UwhrjIoyKP34DY09rzITPJd_e5QuH3OxQjxmh7GIZXuYvNzsMB2kdBt9McwyQJSTpYoXHhacH9iEO7ypHCFPuOpMDCEqMMWSKlkwqtTqkrIXYFA1VPzDUZ_bEt1dQI Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Project-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01aedc5467e84f3788269d2f35ff4cb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01aedc5467e84f3788269d2f35ff4cb0"}]}] Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Tenant-Id: 01aedc5467e84f3788269d2f35ff4cb0 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1593181551 Apr 14 12:00:42 user devstack@n-api.service[61701]: X-User: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:42 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:00:42 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:00:42 user devstack@n-api.service[61701]: X-User-Id: 07e15f00ba92432e9c4a222e1b40c9ab Apr 14 12:00:42 user devstack@n-api.service[61701]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1593181551-project-member Apr 14 12:00:42 user devstack@n-api.service[61701]: method: > Apr 14 12:00:42 user devstack@n-api.service[61701]: exception: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61701]: action_args: {'id': 'b97d3633-4864-45fa-8d87-968507e13639'} Apr 14 12:00:42 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. Apr 14 12:00:42 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] Returning 404 to user: Instance b97d3633-4864-45fa-8d87-968507e13639 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-26b76be7-c183-4478-bc62-e7d97fb382fd tempest-TaggedBootDevicesTest_v242-1593181551 tempest-TaggedBootDevicesTest_v242-1593181551-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639" status: 404 len: 111 microversion: 2.42 time: 0.032631 Apr 14 12:00:42 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 86/260] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:42 2023] GET /compute/v2.1/servers/b97d3633-4864-45fa-8d87-968507e13639 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f3089a7a-508a-4f53-94af-e78f654f3db4 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342216412" status: 204 len: 0 microversion: 2.32 time: 0.025476 Apr 14 12:00:42 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 89/261] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 12:00:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342216412 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d60a2fbc-9189-4b30-96ac-16d35138d669"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0bc63f0c-ad34-4293-9aea-4ad0987324e0 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1672 microversion: 2.1 time: 0.563289 Apr 14 12:00:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 87/262] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:44 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1672 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-decfbd47-ea4a-49d4-9b9d-dfe7ac9b615c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.547172 Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 87/263] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 12:00:45 2023] POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments => generated 188 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e8a20fb6-0753-426d-8ea1-96721ab373bd tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061713 Apr 14 12:00:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 90/264] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:00:45 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:45 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61701) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 12:00:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-d44ed0ef-c59e-4159-ad49-c064ca9570c5 tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20" status: 204 len: 0 microversion: 2.1 time: 0.220546 Apr 14 12:00:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:00:45 2023] DELETE /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:00:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-448ee22e-0eda-4000-a4c1-e3489c657375 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/action" status: 202 len: 0 microversion: 2.20 time: 0.186399 Apr 14 12:00:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 88/266] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:00:45 2023] POST /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:46 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bdd450e1-670d-4995-8fea-d5ca4e230640 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1740 microversion: 2.20 time: 0.377131 Apr 14 12:00:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 89/267] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:46 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 12:00:46 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "name": "network-vif-unplugged", "status": "completed", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] Creating event network-vif-unplugged:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 12:00:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0a2932b7-523b-4124-a26a-f3639f7a36be req-636e7122-adbb-4436-98d3-6db3344a3c14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041059 Apr 14 12:00:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:46 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b28366f58e4c6b95d0f9d39ae73fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8170ca28d84853b1e641b5acbb9708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:46 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-bd09a45e-3464-4e8b-9627-2b8b5111f23e tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20" status: 200 len: 1647 microversion: 2.1 time: 0.683023 Apr 14 12:00:46 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:46 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 => generated 1647 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HTTP exception thrown: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Request method failure captured: Apr 14 12:00:47 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 HTTP/1.1 Apr 14 12:00:47 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:00:47 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:00:47 user devstack@n-api.service[61700]: Connection: close Apr 14 12:00:47 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:00:47 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:00:47 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:00:47 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:00:47 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-FcsCmUOMrVAJari3xAktI2Z1lI9JvHn6_09G13PWZyzbZJ4ZEdXhTNO9VlVQx2MwUdEMUHcRtm8rHBoY0ekKLBhhrYLS0LaM6eF0CAQpmimE_Snq758oSv_8IzMuxcBGcuWdoj-gFPZCRXawPYbsAyne1lV3wK9IBzXQ5IDsmNws Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Project-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Project-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62161098b7244829bdeba1cfd1d6b970"}]}] Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Tenant: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Tenant-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-User: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:47 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:00:47 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:00:47 user devstack@n-api.service[61700]: X-User-Id: e0497d49f8544fe6b28101364faaadd7 Apr 14 12:00:47 user devstack@n-api.service[61700]: X-User-Name: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:47 user devstack@n-api.service[61700]: method: > Apr 14 12:00:47 user devstack@n-api.service[61700]: exception: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61700]: action_args: {'id': '132e2ee3-a757-42ef-b0ae-3441dca65da5'} Apr 14 12:00:47 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Returning 404 to user: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9077b81e-c5df-4247-83d5-d96abe8dff90 tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 404 len: 111 microversion: 2.32 time: 0.048852 Apr 14 12:00:47 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 90/270] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:00:47 2023] DELETE /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] [instance: 132e2ee3-a757-42ef-b0ae-3441dca65da5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] HTTP exception thrown: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Request method failure captured: Apr 14 12:00:47 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 HTTP/1.1 Apr 14 12:00:47 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:00:47 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:00:47 user devstack@n-api.service[61701]: Connection: close Apr 14 12:00:47 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:00:47 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:00:47 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:00:47 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:00:47 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-FcsCmUOMrVAJari3xAktI2Z1lI9JvHn6_09G13PWZyzbZJ4ZEdXhTNO9VlVQx2MwUdEMUHcRtm8rHBoY0ekKLBhhrYLS0LaM6eF0CAQpmimE_Snq758oSv_8IzMuxcBGcuWdoj-gFPZCRXawPYbsAyne1lV3wK9IBzXQ5IDsmNws Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Project-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Project-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62161098b7244829bdeba1cfd1d6b970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62161098b7244829bdeba1cfd1d6b970"}]}] Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Tenant: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Tenant-Id: 62161098b7244829bdeba1cfd1d6b970 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1490636318 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-User: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:47 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:00:47 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:00:47 user devstack@n-api.service[61701]: X-User-Id: e0497d49f8544fe6b28101364faaadd7 Apr 14 12:00:47 user devstack@n-api.service[61701]: X-User-Name: tempest-TaggedBootDevicesTest-1490636318-project-member Apr 14 12:00:47 user devstack@n-api.service[61701]: method: > Apr 14 12:00:47 user devstack@n-api.service[61701]: exception: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61701]: action_args: {'id': '132e2ee3-a757-42ef-b0ae-3441dca65da5'} Apr 14 12:00:47 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. Apr 14 12:00:47 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:00:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] Returning 404 to user: Instance 132e2ee3-a757-42ef-b0ae-3441dca65da5 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:00:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9a12a5e0-ff6a-4b84-8426-1eff7320cb0f tempest-TaggedBootDevicesTest-1490636318 tempest-TaggedBootDevicesTest-1490636318-project-member] 10.0.0.210 "GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5" status: 404 len: 111 microversion: 2.32 time: 0.033699 Apr 14 12:00:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 90/271] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:47 2023] GET /compute/v2.1/servers/132e2ee3-a757-42ef-b0ae-3441dca65da5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d987d86e-92eb-4c3d-a537-909b62392bff"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "name": "network-vif-deleted", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] Creating event network-vif-deleted:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 12:00:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-826e7d96-09d6-43a4-80d5-f1c018502fb2 req-1020cd2b-7941-4a32-8991-93e75c0d23f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Apr 14 12:00:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8ec47088-a177-4fbc-a2bf-ac83249cd7ea tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388973 Apr 14 12:00:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 92/273] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:00:48 2023] POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c3100c-5b90-47a1-8c3b-fb53467fcd20", "name": "network-vif-plugged", "status": "completed", "tag": "c7a8788d-e6ec-4958-8755-b88f421793c3"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] Creating event network-vif-plugged:c7a8788d-e6ec-4958-8755-b88f421793c3 for instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 on user Apr 14 12:00:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-03d49ee8-3eda-4a19-af10-bf6435fdbadb req-83e481c7-677b-4d67-bae0-4c4647ec3542 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051953 Apr 14 12:00:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 91/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-378271548", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "609095b3-aa7f-45b1-a300-792fe3c6435a"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] validate_networks() for [('609095b3-aa7f-45b1-a300-792fe3c6435a', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for user 11df88c60e4b456691d8731fe8facf38 and project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:00:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:00:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e9523609-f75b-4138-9fdd-418a5648e813 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.713235 Apr 14 12:00:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 92/275] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 12:00:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 12:00:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-fa2bdcdc-b883-4f8a-aaaa-4533c92fc3aa tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1394 microversion: 2.87 time: 0.088067 Apr 14 12:00:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:00:52 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1394 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:00:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a7e7b608-a27e-4187-a845-534b5d00b895 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1747 microversion: 2.1 time: 0.397807 Apr 14 12:00:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 92/277] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:00:54 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1747 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:00:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] Creating event network-changed:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:00:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7aa5b39e-baf9-4074-8cda-98284eb3d21e req-791d32a2-4e6f-44b2-b3da-c3066621f363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Apr 14 12:00:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 93/278] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:00:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:00:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:00:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:00:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:00:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] Creating event network-changed:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:00:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-fbeb00c0-dc4b-4b81-bee9-93598e20a1db req-6c47aaf0-423e-4101-9f0a-28597dc13bc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047453 Apr 14 12:00:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 94/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "d4a621c0-2cd8-43d1-9ce1-86953bcc79e9"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:02 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'flavor' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:01:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-548df081-34a1-4e98-898b-80032d2c7cd8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action" status: 200 len: 29 microversion: 2.1 time: 0.288925 Apr 14 12:01:02 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 93/280] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:01:02 2023] POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action => generated 29 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:03 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:03 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a7deaa83-7f72-4030-893a-1881b895bdb8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1724 microversion: 2.1 time: 0.229252 Apr 14 12:01:03 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:02 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:01:04 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:01:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-c818be27-e946-4422-8b41-66b07bfcb0eb req-ab6baa11-2047-49b3-868c-e454144e8eb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048707 Apr 14 12:01:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:01:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-unplugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] Creating event network-vif-unplugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:01:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-44f8e2e3-7484-454f-a8f8-3427ffbd42e7 req-70fb30e5-bf4b-4c19-9a6a-9f4e698e711b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053337 Apr 14 12:01:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 94/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:06 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:01:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-c8d5e2aa-9484-4f66-bc84-220210f97c4a req-0ebdaacc-6024-4477-a7dc-2012cf33ce01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064527 Apr 14 12:01:06 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 95/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:01:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f5f36c4e-9441-494e-8b85-2bdf86a51e48 req-1e5e7150-0f25-470e-be1c-b47c268c18db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041980 Apr 14 12:01:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 96/285] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:06 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:07 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b260d31c-3dfb-46b8-b4fc-3f1898931aff tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" status: 200 len: 1495 microversion: 2.1 time: 0.230528 Apr 14 12:01:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 95/286] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:06 2023] GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => generated 1495 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:01:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:01:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-4dd65993-7ed2-4fba-833e-fb4fafaba488 req-35e4ca6a-cef3-49af-ab39-784ba179b55d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080817 Apr 14 12:01:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 96/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:11 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:01:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-1b9f4dd2-9487-4ed9-8c99-a39938ef6af3 req-e102ea0e-5491-4fd7-98df-495f433584c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053984 Apr 14 12:01:11 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}, {"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:13 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:01:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:01:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9530a57d-eb80-4d81-9dbc-eaf98f28b3b1 req-643b635d-368c-4c42-a55b-c796023f93f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043229 Apr 14 12:01:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:21 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:21 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e8f102f7-a937-4d0c-889e-a4efeda5d961 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: .version_select at 0x7f4371991c60>, body: {"keypair": {"name": "tempest-keypair-2086314618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnFM5Nefv6RtCW1/Y2HIsb1wZROJ1n7/i/A9NFor9KcykdzJ6KovlvgqgY6K7i63VtjmMNWto/7ItIKN9FUMaROb5mIoRccq+moX6HYBS18y0HUtwG21fTQB1pzCcge2g=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:21 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e8f102f7-a937-4d0c-889e-a4efeda5d961 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:01:21 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e8f102f7-a937-4d0c-889e-a4efeda5d961 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:01:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e8f102f7-a937-4d0c-889e-a4efeda5d961 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483296 Apr 14 12:01:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 97/290] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:01:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-523755696", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "12b17cd5-254d-41fb-b300-9968f8c873ec"}], "security_groups": [{"name": "tempest-securitygroup--1391015000"}], "key_name": "tempest-keypair-2086314618", "user_data": "}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] validate_networks() for [('12b17cd5-254d-41fb-b300-9968f8c873ec', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:01:24 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:01:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-994f3574-e2d4-4732-b5fc-c1c210466316 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.626425 Apr 14 12:01:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 98/291] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:01:23 2023] POST /compute/v2.1/servers => generated 407 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:01:24 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:24 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:24 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ef0ad89e-cff8-419f-9417-8c06f05b2bfb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:24 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ef0ad89e-cff8-419f-9417-8c06f05b2bfb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:24 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-ef0ad89e-cff8-419f-9417-8c06f05b2bfb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:24 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ef0ad89e-cff8-419f-9417-8c06f05b2bfb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1232 microversion: 2.1 time: 0.080328 Apr 14 12:01:24 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 97/292] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:24 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1232 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:01:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] Creating event network-changed:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:01:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-2ed94fdc-5fd0-4cbf-a229-be03be3c4bfb req-f58d0716-8df8-4995-a05c-0751debcccf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038991 Apr 14 12:01:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 98/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:01:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ec53c8c7-1389-4e3d-8bac-7d9278a72bf4 req-a76a9c76-b2eb-4b64-8824-76db6a2ab3e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064305 Apr 14 12:01:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:01:31 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:01:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0777a50f-366f-4930-b2b0-2666d10450b3 req-7abaff92-d56b-48a3-81b2-858d602b076b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030855 Apr 14 12:01:31 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 98/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1585756320", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] validate_networks() for None {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Getting quotas for project cc91a871a3dc4a5a81f6bac70701177b. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Getting quotas for user 288a3cdba40944e0b3bb945ba21d2f1d and project cc91a871a3dc4a5a81f6bac70701177b. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:01:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:01:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ca7a0196-5222-4c64-8e07-fe77a6492072 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.040252 Apr 14 12:01:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:01:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:01:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-98074241-4f7c-4d67-8478-d5b73696f965 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-98074241-4f7c-4d67-8478-d5b73696f965 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-98074241-4f7c-4d67-8478-d5b73696f965 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288a3cdba40944e0b3bb945ba21d2f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a871a3dc4a5a81f6bac70701177b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-98074241-4f7c-4d67-8478-d5b73696f965 tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77" status: 200 len: 1209 microversion: 2.1 time: 0.216795 Apr 14 12:01:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:35 2023] GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 => generated 1209 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:36 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-db04b07f-1abe-40a7-8c00-b942d4cac087 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1785 microversion: 2.20 time: 0.213588 Apr 14 12:01:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 99/298] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:01:36 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1785 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] [instance: 34c3100c-5b90-47a1-8c3b-fb53467fcd20] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] HTTP exception thrown: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Request method failure captured: Apr 14 12:01:36 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 HTTP/1.1 Apr 14 12:01:36 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:01:36 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:01:36 user devstack@n-api.service[61700]: Connection: close Apr 14 12:01:36 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:01:36 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:01:36 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:01:36 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:01:36 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT98zBbSL3bExgjXIslPwuyb22sREuakW8OLRSf7KdGlILrnQp2EGU03BE3aLXVRhqMp8fRgOk0DurLQZvnCF__9O-wz2J6sjfwAWiYVqP2JmMH_-bJ_Tbz4Ec6Qh9KgEDJOPzUeJlujNRhBVk-V93yUqIigK_xHKm3hFqqkdI9y70A Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Project-Id: ec8170ca28d84853b1e641b5acbb9708 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestVolumeSwap-1357355751 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec8170ca28d84853b1e641b5acbb9708"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec8170ca28d84853b1e641b5acbb9708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec8170ca28d84853b1e641b5acbb9708"}]}] Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Tenant: tempest-TestVolumeSwap-1357355751 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Tenant-Id: ec8170ca28d84853b1e641b5acbb9708 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestVolumeSwap-1357355751 Apr 14 12:01:36 user devstack@n-api.service[61700]: X-User: tempest-TestVolumeSwap-1357355751-project-member Apr 14 12:01:36 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:01:36 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:01:36 user devstack@n-api.service[61700]: X-User-Id: 99b28366f58e4c6b95d0f9d39ae73fbe Apr 14 12:01:36 user devstack@n-api.service[61700]: X-User-Name: tempest-TestVolumeSwap-1357355751-project-member Apr 14 12:01:36 user devstack@n-api.service[61700]: method: > Apr 14 12:01:36 user devstack@n-api.service[61700]: exception: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. Apr 14 12:01:36 user devstack@n-api.service[61700]: action_args: {'id': '34c3100c-5b90-47a1-8c3b-fb53467fcd20'} Apr 14 12:01:36 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. Apr 14 12:01:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:01:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Returning 404 to user: Instance 34c3100c-5b90-47a1-8c3b-fb53467fcd20 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:01:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-febc309f-a981-4d71-9b21-fe382fa0793d tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20" status: 404 len: 111 microversion: 2.1 time: 0.054894 Apr 14 12:01:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:36 2023] GET /compute/v2.1/servers/34c3100c-5b90-47a1-8c3b-fb53467fcd20 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:01:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d6188269-fcc3-4557-96dd-3b78790abe9a tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] Calling method '.version_select at 0x7f4371951510>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d6188269-fcc3-4557-96dd-3b78790abe9a tempest-TestVolumeSwap-1357355751 tempest-TestVolumeSwap-1357355751-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235067215" status: 202 len: 0 microversion: 2.1 time: 0.025966 Apr 14 12:01:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:01:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235067215 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:01:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] Creating event network-changed:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:01:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e6446bba-740b-46a3-94e6-bb78f0923996 req-d05774bb-b33f-4e03-b981-ab478566d14c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036382 Apr 14 12:01:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 100/301] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:39 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 16a25a1d-bc8b-4de0-b975-037aee0d46ee {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:01:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b22020fb-da7b-442a-9272-de1b0547ebf4 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/action" status: 200 len: 32 microversion: 2.1 time: 0.178006 Apr 14 12:01:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 101/302] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:01:39 2023] POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:39 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9709177b-dc81-495c-9c71-a2b25b27b7f7 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1510 microversion: 2.1 time: 0.182857 Apr 14 12:01:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:39 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:01:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] Creating event network-vif-unplugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:01:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-7e8d8fe7-f65a-4c8c-8aae-ee65c8132ce6 req-8b0df6aa-0bdf-4b78-851d-391050efab22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042612 Apr 14 12:01:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 101/304] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "name": "network-vif-plugged", "status": "completed", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] Creating event network-vif-plugged:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:01:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ae84c3ab-5301-4209-accf-feb9425c80be req-add7805e-4764-48fc-be46-c4970ae2286d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046686 Apr 14 12:01:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 102/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:01:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-f1c33786-9bf3-47e0-a3ca-a7f385eea967 req-2c047d2a-c774-4666-bc55-37f6c9b351a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Apr 14 12:01:42 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 102/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:42 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7fc0799a-9f53-49e6-acac-b83a2beb1403 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1769 microversion: 2.87 time: 0.570583 Apr 14 12:01:42 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 103/307] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:01:42 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1769 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:01:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "name": "network-vif-plugged", "status": "completed", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] Creating event network-vif-plugged:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:01:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-9f2b0a70-dcc2-42fa-a413-572890dc3319 req-ec9ea829-5e07-4ffc-86c7-3039ba7a041c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036290 Apr 14 12:01:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}, {"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:01:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:01:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-30df8bff-b658-4996-814f-7e506e42c183 req-621dc0da-f0af-4f7a-82b2-e1605f68e9e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038737 Apr 14 12:01:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=17 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:53 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:01:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f0ecdf81-01e5-4e06-bdf4-3ff0c2522e4b tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1704 microversion: 2.1 time: 0.496765 Apr 14 12:01:53 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:01:53 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1704 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:01:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-fa59bde7-dd20-4a06-a0a6-3d203d695210 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Action: 'create', calling method: .version_select at 0x7f4371990af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1092797958", "metadata": {"Type": "work"}}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-836687135"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-fa59bde7-dd20-4a06-a0a6-3d203d695210 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.567987 Apr 14 12:01:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 104/311] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 12:01:54 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 569 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 12:01:55 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-48f7541a-ed05-42fc-9e0e-84be7c957d2e tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f4371aea8c0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-48f7541a-ed05-42fc-9e0e-84be7c957d2e tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 353 microversion: 2.1 time: 0.101739 Apr 14 12:01:55 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:55 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:55 user devstack@n-api.service[61701]: INFO nova.network.security_group_api [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Removing security group 23ebe7d9-0021-4e72-aa3c-c364203bf498 from port 1aad7982-a338-4425-9e53-ea99f31b0de6 Apr 14 12:01:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5986bec3-1c00-4670-83d8-338d14474fbc tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action" status: 202 len: 0 microversion: 2.1 time: 1.115844 Apr 14 12:01:56 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:01:55 2023] POST /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 12:01:56 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:56 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:56 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:56 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:56 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] Creating event network-changed:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:01:56 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ea87db07-1d82-46b7-9586-da8b6164699c req-36a81c98-331c-4522-9216-e16aca96a2cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053804 Apr 14 12:01:56 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 105/314] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-09b15f25-8245-4b18-9eb8-86e0a239ac39 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f4371951cf0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-09b15f25-8245-4b18-9eb8-86e0a239ac39 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 354 microversion: 2.1 time: 0.074078 Apr 14 12:01:56 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:56 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:56 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ca60b5fb-7c86-482d-8cfe-004d9178933c tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f437176bac0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ca60b5fb-7c86-482d-8cfe-004d9178933c tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 354 microversion: 2.1 time: 0.057115 Apr 14 12:01:56 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 105/316] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:56 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:56 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-78ce2b05-b920-4789-9af0-241c19c7080a tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f43719931c0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:56 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-78ce2b05-b920-4789-9af0-241c19c7080a tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 202 len: 0 microversion: 2.1 time: 0.084956 Apr 14 12:01:56 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 106/317] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:01:56 2023] DELETE /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 12:01:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e9fe82c0-7623-4491-bd96-51b471fe887d tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f4371aeab00>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e9fe82c0-7623-4491-bd96-51b471fe887d tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 353 microversion: 2.1 time: 0.072743 Apr 14 12:01:56 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:56 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] Creating event network-changed:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:01:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-31b6c5f5-bdfe-413a-a1d5-5ec2bb0bb4bf req-b596467b-424b-4fd9-9e72-308f7fbe3084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035920 Apr 14 12:01:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:57 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'services' on Instance uuid 25eda1c2-9b82-412f-b75d-358e87847a29 {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:01:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-dd297ae3-7738-4546-a41e-6e7d74d98ad5 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f4371950700>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5cc1cef0-a057-41dc-8f2d-fd60d2fa91db tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments/02f6321c-fa2b-4e36-8b89-caffe1df4027" status: 202 len: 0 microversion: 2.1 time: 0.244825 Apr 14 12:01:57 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 107/320] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:01:57 2023] DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments/02f6321c-fa2b-4e36-8b89-caffe1df4027 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:01:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:01:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5612da6b-f2ce-4053-893f-52e62244bfc7 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071163 Apr 14 12:01:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 107/321] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:01:57 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:01:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-dd297ae3-7738-4546-a41e-6e7d74d98ad5 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 353 microversion: 2.1 time: 0.129527 Apr 14 12:01:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 108/322] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:57 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:01:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-452d7944-b511-4ab3-a648-9d22469cb76c tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f4371993010>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:01:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-452d7944-b511-4ab3-a648-9d22469cb76c tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 200 len: 353 microversion: 2.1 time: 0.070630 Apr 14 12:01:59 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:01:58 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fb519c37-c636-4b6f-867f-49d19b1fa320 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Calling method '.version_select at 0x7f437182b910>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-fb519c37-c636-4b6f-867f-49d19b1fa320 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] HTTP exception thrown: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. Apr 14 12:02:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fb519c37-c636-4b6f-867f-49d19b1fa320 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Request method failure captured: Apr 14 12:02:00 user devstack@n-api.service[61701]: request: GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 HTTP/1.1 Apr 14 12:02:00 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:02:00 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:02:00 user devstack@n-api.service[61701]: Connection: close Apr 14 12:02:00 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:02:00 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:02:00 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:02:00 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:02:00 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUCyxSJRGS_YDP8DDYOoDbCywFImq_F9207ryoBiSptdTXoNRdZNBnq7o0fmfQaqrLgIgtAC1SR7PGcJANFKqqX4FlDp1lKyx5RfrkVqL4-PgoFsaAhCTirjjBHavdZnz-EWVNInDS0pFImjYoDLQsr_hjjKPpaDh5hCzTgUHFoXOxE Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Project-Id: 05ed5d00e50b40109e54601796670aa8 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesGetTestJSON-1348278528 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05ed5d00e50b40109e54601796670aa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/05ed5d00e50b40109e54601796670aa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/05ed5d00e50b40109e54601796670aa8"}]}] Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesGetTestJSON-1348278528 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Tenant-Id: 05ed5d00e50b40109e54601796670aa8 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesGetTestJSON-1348278528 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-User: tempest-VolumesGetTestJSON-1348278528-project-member Apr 14 12:02:00 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:02:00 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:02:00 user devstack@n-api.service[61701]: X-User-Id: 13085e8af24545679daa094b0df9fd62 Apr 14 12:02:00 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesGetTestJSON-1348278528-project-member Apr 14 12:02:00 user devstack@n-api.service[61701]: method: Apr 14 12:02:00 user devstack@n-api.service[61701]: exception: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. Apr 14 12:02:00 user devstack@n-api.service[61701]: action_args: {'id': 'ba06954b-4ffa-482c-b6ba-2d3eb9d88042'} Apr 14 12:02:00 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. (HTTP 404) (Request-ID: req-107aaa6d-38bd-4651-93d4-9266dbbece2d) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. Apr 14 12:02:00 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:02:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fb519c37-c636-4b6f-867f-49d19b1fa320 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] Returning 404 to user: Volume ba06954b-4ffa-482c-b6ba-2d3eb9d88042 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:02:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-fb519c37-c636-4b6f-867f-49d19b1fa320 tempest-VolumesGetTestJSON-1348278528 tempest-VolumesGetTestJSON-1348278528-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042" status: 404 len: 109 microversion: 2.1 time: 0.043762 Apr 14 12:02:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 108/324] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:02:00 2023] GET /compute/v2.1/os-volumes/ba06954b-4ffa-482c-b6ba-2d3eb9d88042 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d43311ae-a2c6-413d-9134-24fbfa164c88"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] HTTP exception thrown: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Request method failure captured: Apr 14 12:02:09 user devstack@n-api.service[61699]: request: PUT /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/os-volume_attachments/251d0981-667b-47e0-bdb8-55749044ba8a HTTP/1.1 Apr 14 12:02:09 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:02:09 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:02:09 user devstack@n-api.service[61699]: Connection: close Apr 14 12:02:09 user devstack@n-api.service[61699]: Content-Length: 74 Apr 14 12:02:09 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:02:09 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:02:09 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:02:09 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-aSVDRhJR5jTW_64Pd6o9d3Q7bCY6Tm6swG4FeXEsREujo922xu_HmjJxlg7T6GUdAci10V1CM35i2f7RcJZIm2ENWXZgC6SOxSNogONal5XQZOkj1P6tnvucJU8b4VfCEfMr7egaM8avNS5wx9oJ075cE27RH7O8Y08XRfQMWu8U Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Project-Id: b36f9595c1a14773877759f538608990 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesAdminNegativeTest-122603020 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Role: admin,reader,member Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Roles: admin,reader,member Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b36f9595c1a14773877759f538608990"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b36f9595c1a14773877759f538608990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b36f9595c1a14773877759f538608990"}]}] Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesAdminNegativeTest-122603020 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Tenant-Id: b36f9595c1a14773877759f538608990 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-122603020 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-User: tempest-VolumesAdminNegativeTest-122603020-project-admin Apr 14 12:02:09 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:02:09 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:02:09 user devstack@n-api.service[61699]: X-User-Id: e8037cf8830b406394146e2f490a6e28 Apr 14 12:02:09 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesAdminNegativeTest-122603020-project-admin Apr 14 12:02:09 user devstack@n-api.service[61699]: Apr 14 12:02:09 user devstack@n-api.service[61699]: {"volumeAttachment": {"volumeId": "d43311ae-a2c6-413d-9134-24fbfa164c88"}} Apr 14 12:02:09 user devstack@n-api.service[61699]: method: > Apr 14 12:02:09 user devstack@n-api.service[61699]: exception: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. Apr 14 12:02:09 user devstack@n-api.service[61699]: action_args: {'server_id': '33c5eb35-5061-43d1-8c9b-fb88b7bc8c84', 'id': '251d0981-667b-47e0-bdb8-55749044ba8a', 'body': {'volumeAttachment': {'volumeId': 'd43311ae-a2c6-413d-9134-24fbfa164c88'}}} Apr 14 12:02:09 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. (HTTP 404) (Request-ID: req-62d01268-15b8-4d95-8849-b6fcde6fa5ab) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. Apr 14 12:02:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:02:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] Returning 404 to user: Volume 251d0981-667b-47e0-bdb8-55749044ba8a could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:02:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-856cd57d-6632-464d-9e5a-1f5f53e255f4 tempest-VolumesAdminNegativeTest-122603020 tempest-VolumesAdminNegativeTest-122603020-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/os-volume_attachments/251d0981-667b-47e0-bdb8-55749044ba8a" status: 404 len: 109 microversion: 2.1 time: 0.074718 Apr 14 12:02:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 12:02:09 2023] PUT /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84/os-volume_attachments/251d0981-667b-47e0-bdb8-55749044ba8a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:02:12 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:12 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-6820eacd-4358-462a-84a8-80f0ce7d0b44 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'create', calling method: .version_select at 0x7f43719939a0>, body: {"keypair": {"name": "tempest-TestStampPattern-1794429979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcWumXfNSjLDovtKNaUkPPvNJyQGmlmWEq5lmR1ljchHoI3F3BUNa7dKibvc69DYc5cYCD1AWmxfaa3wcxsCbua+WlZRoR5F/ExK2Ac04hcBu8nxWqQ13C+9/nYhnqwIg=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:12 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-6820eacd-4358-462a-84a8-80f0ce7d0b44 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:02:12 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-6820eacd-4358-462a-84a8-80f0ce7d0b44 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for user e2b8b516910f41ffbb8bbf5f9e3c2ec8 and project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:02:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-6820eacd-4358-462a-84a8-80f0ce7d0b44 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.212612 Apr 14 12:02:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 109/326] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:02:12 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=12 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:02:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5453b6d6-412c-42e6-82de-fde036e10cb6 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" status: 204 len: 0 microversion: 2.1 time: 0.124423 Apr 14 12:02:14 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 109/327] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:02:14 2023] DELETE /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6e72291a-de5a-4ffd-a41d-23f9a3157261 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" status: 200 len: 1501 microversion: 2.1 time: 0.274921 Apr 14 12:02:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:14 2023] GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:14 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "name": "network-vif-unplugged", "status": "completed", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] Creating event network-vif-unplugged:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:02:14 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-2ae64c2a-dcd9-4816-bd7f-e65f1be2466c req-8a585edf-bf32-4f79-b680-b127fcb6a7e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088409 Apr 14 12:02:14 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 110/329] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:15 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-20a9d5b6-c747-4d58-8257-cbbb7b536760 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1538 microversion: 2.1 time: 0.381241 Apr 14 12:02:15 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:14 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1538 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "name": "network-vif-deleted", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] Creating event network-vif-deleted:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:02:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-714aaeaf-783b-4ce1-8818-33f458bf59b8 req-ff067637-e017-4757-8613-59338d8e55f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105190 Apr 14 12:02:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c5eb35-5061-43d1-8c9b-fb88b7bc8c84", "name": "network-vif-plugged", "status": "completed", "tag": "dccd217a-dfee-484e-a4cd-2d94ba4326ab"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] Creating event network-vif-plugged:dccd217a-dfee-484e-a4cd-2d94ba4326ab for instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 on user Apr 14 12:02:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-f0166f69-053e-433f-9807-225366924b68 req-a8190477-b4b1-4555-82a6-cc14eba8da88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Apr 14 12:02:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1734254147", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1794429979", "security_groups": [{"name": "tempest-secgroup-smoke-261590676"}], "networks": [{"uuid": "322f7f95-663e-4341-af0e-2a66ec4a1c70"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:16 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] validate_networks() for [('322f7f95-663e-4341-af0e-2a66ec4a1c70', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for user e2b8b516910f41ffbb8bbf5f9e3c2ec8 and project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:02:17 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:02:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-553e42bd-3c7c-434f-b8f1-ba5155657ba6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.677977 Apr 14 12:02:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 111/333] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:02:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:02:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0387e8b5-09af-45dd-9467-57b94a8fdcb4 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-0387e8b5-09af-45dd-9467-57b94a8fdcb4 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:17 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-0387e8b5-09af-45dd-9467-57b94a8fdcb4 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0387e8b5-09af-45dd-9467-57b94a8fdcb4 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 200 len: 1237 microversion: 2.1 time: 0.073141 Apr 14 12:02:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:17 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] Creating event network-changed:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:02:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-29aa06e6-756f-47ee-a140-7c7a2724e6fc req-464e3b36-bcef-4ce4-9f39-3900857ac595 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029288 Apr 14 12:02:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:22 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:02:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-33adf7bf-c283-4338-851f-4522db76ca0c req-bb9bcad1-2d60-4501-8814-c6d5fb8db940 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037930 Apr 14 12:02:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:02:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-3f7a7ef9-c2fe-4261-a086-84c5aff167ea req-20baec89-08a7-4c60-af94-2cbb2253b5bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031827 Apr 14 12:02:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 113/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:25 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288a3cdba40944e0b3bb945ba21d2f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a871a3dc4a5a81f6bac70701177b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ec256b9e-1338-4e5d-8f91-a13ac1f40f6b tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77" status: 200 len: 1453 microversion: 2.1 time: 0.167976 Apr 14 12:02:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:25 2023] GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1278423122", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] validate_networks() for [('c4fb3dc6-20fb-4fce-ac17-7c676652dfe8', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting quotas for project ae5ac6388692423b9bf23bf6be0cb06d. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting quotas for user 61adadbd79ef493889ef3dcb63f63fd8 and project ae5ac6388692423b9bf23bf6be0cb06d. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:02:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:02:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2936a4a3-e823-4602-8c7c-f064b3191f5a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.509302 Apr 14 12:02:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 113/339] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:02:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:02:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-6e29f3f2-fc82-407b-972d-1ed4437cdd79 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:29 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:29 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-6e29f3f2-fc82-407b-972d-1ed4437cdd79 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d236ffd0-2b2b-48cd-b3c7-e1cd81392b5a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1490 microversion: 2.1 time: 0.316381 Apr 14 12:02:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:29 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1490 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:29 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-6e29f3f2-fc82-407b-972d-1ed4437cdd79 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-6e29f3f2-fc82-407b-972d-1ed4437cdd79 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d" status: 200 len: 1213 microversion: 2.1 time: 0.079418 Apr 14 12:02:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:29 2023] GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] Creating event network-changed:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:02:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4e8420ff-4e0f-4b05-adf1-cf687016ba76 req-6b5c62d2-843b-4046-ae05-da972d4b3f84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033199 Apr 14 12:02:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 114/342] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "name": "network-vif-plugged", "status": "completed", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] Creating event network-vif-plugged:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:02:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8b600f19-4374-4d41-b038-e878fc740f38 req-ac9869f1-b941-43f6-905b-e1a70fa89900 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Apr 14 12:02:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=12 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0d256d3c-6daf-4e00-83ec-9ec35ffe667b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments/d60a2fbc-9189-4b30-96ac-16d35138d669" status: 200 len: 194 microversion: 2.20 time: 0.193523 Apr 14 12:02:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 115/344] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 12:02:36 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments/d60a2fbc-9189-4b30-96ac-16d35138d669 => generated 194 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'services' on Instance uuid ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:02:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-06107a3f-dfdc-41ba-8276-36e0e20d1338 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments/d60a2fbc-9189-4b30-96ac-16d35138d669" status: 202 len: 0 microversion: 2.20 time: 0.159143 Apr 14 12:02:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 115/345] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 12:02:37 2023] DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments/d60a2fbc-9189-4b30-96ac-16d35138d669 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0cd0f74f-97cb-4fb9-9668-5b8578d5a342 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053078 Apr 14 12:02:37 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 116/346] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 12:02:37 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "name": "network-vif-plugged", "status": "completed", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] Creating event network-vif-plugged:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:02:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ab7d3d0e-8a6d-4d21-b37f-4fae845c4c55 req-754c60d1-96fb-4d1a-b5a3-56ecdd69aadc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044137 Apr 14 12:02:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 116/347] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "72232d56-9ae1-4d93-9ce8-68df7018a366"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:43 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'flavor' on Instance uuid fcd74f51-099e-4c19-af7d-912f622fb153 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:02:43 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e7022bfa-395e-4f97-983b-38f17c4e8f73 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153/action" status: 200 len: 29 microversion: 2.87 time: 0.545566 Apr 14 12:02:43 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 116/348] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:02:43 2023] POST /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153/action => generated 29 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=19 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=29 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:44 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:44 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:44 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7776eb00-3856-431b-81cc-3ddd1623c2e6 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1775 microversion: 2.87 time: 0.154784 Apr 14 12:02:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 117/349] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:02:43 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1775 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-unplugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] Creating event network-vif-unplugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:02:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7617cb52-a570-4a50-ad4d-ba8da3a50f10 req-a4d4e60a-3e1f-4764-b025-a2f42f407074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036433 Apr 14 12:02:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 117/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:46 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:02:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:02:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-d2566c04-9c7a-4eb3-931d-02e5880c6b7e req-16458f02-1a56-4c22-8df2-5865352d3346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061059 Apr 14 12:02:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 117/351] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ff52031a-6be8-4ec4-a732-10ff7975bfaf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.273904 Apr 14 12:02:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:02:48 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments => generated 25 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HTTP exception thrown: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 is not attached to volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Request method failure captured: Apr 14 12:02:48 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments/02f6321c-fa2b-4e36-8b89-caffe1df4027 HTTP/1.1 Apr 14 12:02:48 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:02:48 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:02:48 user devstack@n-api.service[61700]: Connection: close Apr 14 12:02:48 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:02:48 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:02:48 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:02:48 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:02:48 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-pSAkokq8mpEav1B-ziPwZZpdFfVMVB-ZIu1m6U1LHU-EmFjT-x7VDSi4JWxEUntHXcStdkhX71d6Upoy4Ifpo8Z2MyWeVq8QKarDtP-BRPpw8sIIqqAsWABgFKc8OpZBXltons0tSzX1XOIEGWSySGRDuPL4EoCpSFST1BfRcFVM Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Project-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd9936aa363942f6a01bb64a8a8e74c9"}]}] Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Tenant: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Tenant-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:02:48 user devstack@n-api.service[61700]: X-User: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:02:48 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:02:48 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:02:48 user devstack@n-api.service[61700]: X-User-Id: 2eb32a03e7e04da18568294cca0e69bd Apr 14 12:02:48 user devstack@n-api.service[61700]: X-User-Name: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:02:48 user devstack@n-api.service[61700]: method: > Apr 14 12:02:48 user devstack@n-api.service[61700]: exception: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 is not attached to volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 Apr 14 12:02:48 user devstack@n-api.service[61700]: action_args: {'server_id': '25eda1c2-9b82-412f-b75d-358e87847a29', 'id': '02f6321c-fa2b-4e36-8b89-caffe1df4027'} Apr 14 12:02:48 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02f6321c-fa2b-4e36-8b89-caffe1df4027. Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 is not attached to volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 is not attached to volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 Apr 14 12:02:48 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:02:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Returning 404 to user: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 is not attached to volume 02f6321c-fa2b-4e36-8b89-caffe1df4027 {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:02:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-d7890c48-ba5e-454c-902a-b9ae14345567 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments/02f6321c-fa2b-4e36-8b89-caffe1df4027" status: 404 len: 154 microversion: 2.1 time: 0.096509 Apr 14 12:02:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 118/353] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:02:48 2023] DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29/os-volume_attachments/02f6321c-fa2b-4e36-8b89-caffe1df4027 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:02:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:02:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9d56d294-31eb-4b33-96b6-0755c9e2ba57 req-a2c3ec71-145a-447e-9387-7d35e9c4246d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083226 Apr 14 12:02:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:02:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-0ca638cf-0a19-426f-88ff-be73f2a5c89b req-6b6eeda4-eee2-45ad-9eb6-b468d9b29da0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029062 Apr 14 12:02:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:02:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f37f8c5e-1d97-456c-a1b2-9bd8b339620a tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 204 len: 0 microversion: 2.1 time: 0.139328 Apr 14 12:02:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:02:51 2023] DELETE /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:02:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-28211258-2ddd-465e-a809-e3f6d96eedcf tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 200 len: 1542 microversion: 2.1 time: 0.215888 Apr 14 12:02:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 119/357] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:02:51 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 1542 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:02:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-unplugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] Creating event network-vif-unplugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:02:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-496b4f8d-421f-458c-84e2-86db83b6683d req-5a62abc4-7fe8-4483-953c-c85701ccf6fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096268 Apr 14 12:02:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-deleted", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] Creating event network-vif-deleted:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:02:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-95f92de2-64c6-45ba-b1a1-f6bb541aeed7 req-aff7528d-c0dc-4168-955e-bcdca20a0cdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044193 Apr 14 12:02:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 120/359] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-48702ef7-defc-4289-96d4-2966093fdce4 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action" status: 202 len: 0 microversion: 2.1 time: 0.074561 Apr 14 12:02:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 120/360] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:02:53 2023] POST /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-5da7cbba-917a-4b87-a9fb-4f698422df22 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100847 Apr 14 12:02:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:02:53 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-interface => generated 283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eda1c2-9b82-412f-b75d-358e87847a29", "name": "network-vif-plugged", "status": "completed", "tag": "1aad7982-a338-4425-9e53-ea99f31b0de6"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] Creating event network-vif-plugged:1aad7982-a338-4425-9e53-ea99f31b0de6 for instance 25eda1c2-9b82-412f-b75d-358e87847a29 on user Apr 14 12:02:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-d45cc7dc-87e5-4b95-8930-086946222ee8 req-338993b9-054a-4639-85cf-f8477879d556 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048217 Apr 14 12:02:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 121/362] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] Creating event network-changed:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:02:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4789faf7-eb8e-4768-b3cb-013d86caf9dd req-a0f0dd4b-edfc-4c13-bdf4-6c4a6b808186 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044298 Apr 14 12:02:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 121/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}, {"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-unplugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}, {"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:02:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:02:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:02:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:02:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Creating event network-changed:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:02:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Creating event network-vif-unplugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:02:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:02:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7fc5d1df-8cca-4504-9a78-f44aec2f7374 req-60b89e2a-94eb-407f-b186-3dd37ae069ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.045232 Apr 14 12:02:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:57 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:02:59 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}, {"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:03:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:03:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-73b270cc-3404-4529-9d8d-7da1be800d6a req-ab4190ca-591d-4e65-a0a5-393f7093cb55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038825 Apr 14 12:03:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] HTTP exception thrown: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Request method failure captured: Apr 14 12:03:04 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 HTTP/1.1 Apr 14 12:03:04 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:03:04 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:03:04 user devstack@n-api.service[61701]: Connection: close Apr 14 12:03:04 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:03:04 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:03:04 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:03:04 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:03:04 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-AnTx8LntEBo_352eNWkHkeZRESdZ9v0wTszQtkbcIRgUCRq00gHyBcUB6OMjChvD3Rxl7KVTNHFlqecKf5Yz97JnLXKW9v6QwfyV6tZpJJ8ieWSL9WZAMZ6A3dAewpXL7OSsTzFd4fBkv4oYndvk8NPVdfSvvhln-8XG-jMmQEgc Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Project-Id: 8d1dde7a2b6d498cbb829c51bfafadee Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d1dde7a2b6d498cbb829c51bfafadee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d1dde7a2b6d498cbb829c51bfafadee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d1dde7a2b6d498cbb829c51bfafadee"}]}] Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Tenant-Id: 8d1dde7a2b6d498cbb829c51bfafadee Apr 14 12:03:04 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:04 user devstack@n-api.service[61701]: X-User: tempest-VolumesAdminNegativeTest-1955614665-project-member Apr 14 12:03:04 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:03:04 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:03:04 user devstack@n-api.service[61701]: X-User-Id: 390ba60eb6f3478fb8225976ee516218 Apr 14 12:03:04 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesAdminNegativeTest-1955614665-project-member Apr 14 12:03:04 user devstack@n-api.service[61701]: method: > Apr 14 12:03:04 user devstack@n-api.service[61701]: exception: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. Apr 14 12:03:04 user devstack@n-api.service[61701]: action_args: {'id': '33c5eb35-5061-43d1-8c9b-fb88b7bc8c84'} Apr 14 12:03:04 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. Apr 14 12:03:04 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Returning 404 to user: Instance 33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:03:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-3cbb14b9-a35b-4d97-9420-a294bf5c6ab7 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84" status: 404 len: 111 microversion: 2.1 time: 0.030205 Apr 14 12:03:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 122/366] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:04 2023] GET /compute/v2.1/servers/33c5eb35-5061-43d1-8c9b-fb88b7bc8c84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:07 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1a3f8118-fdcf-48cd-93cb-fadeaf384f03 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 200 len: 1537 microversion: 2.1 time: 0.166364 Apr 14 12:03:07 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:07 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:03:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e3dc3e1a-d9d1-4ed3-af91-c6f2f43f03d4 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b" status: 204 len: 0 microversion: 2.1 time: 0.161103 Apr 14 12:03:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 123/368] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:03:07 2023] DELETE /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:03:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:08 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '390ba60eb6f3478fb8225976ee516218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1dde7a2b6d498cbb829c51bfafadee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e2e5a794-3641-40f2-83e2-ddbc27fd485b tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b" status: 200 len: 1669 microversion: 2.1 time: 0.208749 Apr 14 12:03:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:07 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] Creating event network-vif-unplugged:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 12:03:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f2384db5-3395-471b-a05c-887f891d6aee req-52a0b958-7373-4c96-af46-2e1438a90b5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030876 Apr 14 12:03:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 124/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "name": "network-vif-deleted", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] Creating event network-vif-deleted:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 12:03:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-144a597b-eb6a-4296-990c-3cd2b052a28c req-9fcf352f-1f71-4eda-976d-e8c7c961faf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Apr 14 12:03:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 124/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:10 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47955121-a299-4b9b-aa83-0e55cfb52f4b", "name": "network-vif-plugged", "status": "completed", "tag": "c9d9e100-59bd-4f58-8892-80c764c88b85"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:10 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] Creating event network-vif-plugged:c9d9e100-59bd-4f58-8892-80c764c88b85 for instance 47955121-a299-4b9b-aa83-0e55cfb52f4b on user Apr 14 12:03:10 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-a7c75430-758e-4935-9cb5-2b9ae1bce9de req-252202e1-5c34-41e5-ae70-fb61ee34426a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034579 Apr 14 12:03:10 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 124/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=18 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:15 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=30 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-29087c24-b447-453f-b71f-28dd9ab14ca8 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.092414 Apr 14 12:03:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:03:15 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] Creating event network-changed:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:03:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b7a9f6b2-211b-4b2f-8ace-d505230482ac req-7b53f81f-9081-4044-b2db-9a99ce29e4e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Apr 14 12:03:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:16 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-65706373-e343-4f96-bcdc-32be185ed8ac tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1538 microversion: 2.1 time: 0.250768 Apr 14 12:03:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 125/375] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:16 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1538 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:16 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8042b701-b3b5-4399-b9ef-82825f4ad719 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1538 microversion: 2.1 time: 0.170483 Apr 14 12:03:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:16 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1538 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:20 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-379b6cf2-2113-4a28-94eb-8fca1b7f244a tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d" status: 200 len: 1494 microversion: 2.1 time: 0.177551 Apr 14 12:03:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:20 2023] GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d => generated 1494 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=18 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:03:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2e14678e-006a-4bca-b199-b0dfae72ef2e tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77" status: 204 len: 0 microversion: 2.1 time: 0.135831 Apr 14 12:03:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 126/378] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:03:25 2023] DELETE /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:25 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288a3cdba40944e0b3bb945ba21d2f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc91a871a3dc4a5a81f6bac70701177b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-98e0d6c4-2fdb-47b3-ad54-93a12c925e0c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77" status: 200 len: 1459 microversion: 2.1 time: 0.218913 Apr 14 12:03:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:25 2023] GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 => generated 1459 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "name": "network-vif-unplugged", "status": "completed", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] Creating event network-vif-unplugged:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:03:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-952d1564-1f23-45d5-8f9d-9cc6790b1e66 req-2511cdb1-d9a6-4b22-89ee-a26ca4569ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044758 Apr 14 12:03:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 127/380] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "name": "network-vif-deleted", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] Creating event network-vif-deleted:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:03:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4d53eb0c-3e72-458b-9c85-20cf2f94d09b req-c6dd36af-6356-435c-a6f7-d7cee51edf8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Apr 14 12:03:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lazy-loading 'services' on Instance uuid 80b9c47d-7dc8-4bbe-b961-41921a457d98 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ad7f7371-5641-448d-8384-db0a384136a3 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046267 Apr 14 12:03:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 128/382] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 12:03:27 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6db5c412-bf07-499f-8f9e-f9465f934a0e tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments/d987d86e-92eb-4c3d-a537-909b62392bff" status: 202 len: 0 microversion: 2.1 time: 0.168060 Apr 14 12:03:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 128/383] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:03:27 2023] DELETE /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments/d987d86e-92eb-4c3d-a537-909b62392bff => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1b469053-03bd-4ec9-bb1f-d8e8e9354f0a tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Apr 14 12:03:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 128/384] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:03:27 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:03:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f783a249-0928-4df5-a3d7-a95750dc9b6f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 204 len: 0 microversion: 2.20 time: 0.123920 Apr 14 12:03:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:03:27 2023] DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:27 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-a810f291-ed1b-4e48-994f-784b133411bf tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 200 len: 1713 microversion: 2.20 time: 0.207277 Apr 14 12:03:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 129/386] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:03:27 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 1713 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:03:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b9021d-2463-4267-8cb7-cc1c47d54f77", "name": "network-vif-plugged", "status": "completed", "tag": "ced10da8-d1f9-48ae-9e76-68c3008018f1"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] Creating event network-vif-plugged:ced10da8-d1f9-48ae-9e76-68c3008018f1 for instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 on user Apr 14 12:03:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-95f0d219-ee2b-4a7f-810b-e49974b0a92b req-adb16c6c-4609-4131-832e-9afe40174513 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028904 Apr 14 12:03:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 129/387] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-unplugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] Creating event network-vif-unplugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:03:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b0f6d1fb-4909-4312-a3f2-6f1015aab0af req-5b04cac4-cb92-457c-aebc-92a428e1e825 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046034 Apr 14 12:03:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-deleted", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] Creating event network-vif-deleted:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:03:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-49878aae-5c71-495c-a16f-976bce64360f req-59aebfc0-9ab6-464c-8ff5-eb6b74cb5af5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Apr 14 12:03:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bb9e0c-142b-4743-acb6-7437d8d1d6a1"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee while it is in vm_state rescued Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Request method failure captured: Apr 14 12:03:30 user devstack@n-api.service[61701]: request: POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/os-volume_attachments HTTP/1.1 Apr 14 12:03:30 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:03:30 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:03:30 user devstack@n-api.service[61701]: Connection: close Apr 14 12:03:30 user devstack@n-api.service[61701]: Content-Length: 74 Apr 14 12:03:30 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:03:30 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:03:30 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:03:30 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-C9tpHsLruDVTR0wMVP0JRY5wOhKQtycKsYhc-XXk2kYrqcy8r1SONI4mGY7erU46n2nC8PTNnUHogLYf2cSRjef0D9q6JPq1zx-OFsDvX-9rBy0ZayzoXcJuJWuipRYIXF1iz5-PJpHxg_HJGuoaSq17PLUZjtQt7FxBoM6mLbFo Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Project-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f042abdcef8f41488e8f4624c2f4970b"}]}] Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Tenant-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:03:30 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:03:30 user devstack@n-api.service[61701]: X-User: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:03:30 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:03:30 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:03:30 user devstack@n-api.service[61701]: X-User-Id: 263c47076ee94cfaaa34eff928a36fdd Apr 14 12:03:30 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:03:30 user devstack@n-api.service[61701]: Apr 14 12:03:30 user devstack@n-api.service[61701]: {"volumeAttachment": {"volumeId": "d5bb9e0c-142b-4743-acb6-7437d8d1d6a1"}} Apr 14 12:03:30 user devstack@n-api.service[61701]: method: > Apr 14 12:03:30 user devstack@n-api.service[61701]: exception: Cannot 'attach_volume' instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee while it is in vm_state rescued Apr 14 12:03:30 user devstack@n-api.service[61701]: action_args: {'server_id': '16a25a1d-bc8b-4de0-b975-037aee0d46ee', 'body': {'volumeAttachment': {'volumeId': 'd5bb9e0c-142b-4743-acb6-7437d8d1d6a1'}}} Apr 14 12:03:30 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee while it is in vm_state rescued Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee while it is in vm_state rescued Apr 14 12:03:30 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Returning 409 to user: Cannot 'attach_volume' instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee while it is in vm_state rescued {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:03:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-690c7631-b249-42ea-89eb-73b9161211ae tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055920 Apr 14 12:03:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 130/390] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:03:30 2023] POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-70edd75f-cc4a-4104-a0fd-d2b6b1b2a228 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/action" status: 202 len: 0 microversion: 2.1 time: 0.076674 Apr 14 12:03:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 131/391] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:03:30 2023] POST /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:03:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7c2f89-c54f-4e78-b86d-88b4ab5daff4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea071f4-a31f-4eb6-b79b-971106d2c33e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] Creating event network-vif-plugged:7ea071f4-a31f-4eb6-b79b-971106d2c33e for instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 on user Apr 14 12:03:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-525812d6-a022-499e-82e4-565780b55313 req-7df710f2-fc64-4495-bbe4-cb774121dc40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026969 Apr 14 12:03:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:30 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-df77e151-dd50-4288-b743-7100d6a2a915 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1498 microversion: 2.1 time: 0.646214 Apr 14 12:03:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 131/393] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:30 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1498 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}, {"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Creating event network-vif-unplugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:03:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:03:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-d8e6cf07-9dd7-48e8-9a35-fe560e9a5f41 req-4a63cb7c-c01e-4a8b-9f1e-ebb10bcd0c23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030113 Apr 14 12:03:31 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:33 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:03:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-5539cf4d-c097-4f64-8544-61af6f39ff07 req-3b2df7b2-1817-457f-ad94-c4e96d12b6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047908 Apr 14 12:03:33 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:34 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dcd69968-cb0d-44b8-928c-5c121757f7c3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1755 microversion: 2.87 time: 0.218916 Apr 14 12:03:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 132/396] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:03:34 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 12:03:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:03:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-507ff7e0-6953-4fc4-8655-94936026a6f5 req-f753be61-68b3-4bd9-a093-ac7d16ded42c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042351 Apr 14 12:03:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 25eda1c2-9b82-412f-b75d-358e87847a29] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HTTP exception thrown: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Request method failure captured: Apr 14 12:03:42 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 HTTP/1.1 Apr 14 12:03:42 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:03:42 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:03:42 user devstack@n-api.service[61699]: Connection: close Apr 14 12:03:42 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:03:42 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:03:42 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:03:42 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:03:42 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-pSAkokq8mpEav1B-ziPwZZpdFfVMVB-ZIu1m6U1LHU-EmFjT-x7VDSi4JWxEUntHXcStdkhX71d6Upoy4Ifpo8Z2MyWeVq8QKarDtP-BRPpw8sIIqqAsWABgFKc8OpZBXltons0tSzX1XOIEGWSySGRDuPL4EoCpSFST1BfRcFVM Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Project-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd9936aa363942f6a01bb64a8a8e74c9"}]}] Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Tenant: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Tenant-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:03:42 user devstack@n-api.service[61699]: X-User: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:03:42 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:03:42 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:03:42 user devstack@n-api.service[61699]: X-User-Id: 2eb32a03e7e04da18568294cca0e69bd Apr 14 12:03:42 user devstack@n-api.service[61699]: X-User-Name: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:03:42 user devstack@n-api.service[61699]: method: > Apr 14 12:03:42 user devstack@n-api.service[61699]: exception: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. Apr 14 12:03:42 user devstack@n-api.service[61699]: action_args: {'id': '25eda1c2-9b82-412f-b75d-358e87847a29'} Apr 14 12:03:42 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. Apr 14 12:03:42 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:03:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Returning 404 to user: Instance 25eda1c2-9b82-412f-b75d-358e87847a29 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:03:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-84c3f119-a1ad-441f-80e2-4fe69dabbbb4 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29" status: 404 len: 111 microversion: 2.1 time: 0.029159 Apr 14 12:03:42 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:42 2023] GET /compute/v2.1/servers/25eda1c2-9b82-412f-b75d-358e87847a29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:03:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-68d0f900-079b-417a-bac1-e9dc5fcca68d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '.version_select at 0x7f4371872b00>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-68d0f900-079b-417a-bac1-e9dc5fcca68d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-565940781" status: 202 len: 0 microversion: 2.1 time: 0.026323 Apr 14 12:03:42 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 12:03:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-565940781 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:03:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-485fb2df-8bf9-4232-abc1-93a7c3f82477 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: .version_select at 0x7f4371993520>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1755081879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7XKwiLURj1b5DcTPIVltofftkFGkMimaP6U6s5L9tKtbMKTAUfGzDVvjquRa1/D5ZC1MIwS3Ey8mqJF+pxbMc2DT2o0F12fH+EYHR0P8dd1BBqsgvlbTWVDPzdYVfF1A=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:44 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-485fb2df-8bf9-4232-abc1-93a7c3f82477 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:03:44 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-485fb2df-8bf9-4232-abc1-93a7c3f82477 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for user 2eb32a03e7e04da18568294cca0e69bd and project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:03:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-485fb2df-8bf9-4232-abc1-93a7c3f82477 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048469 Apr 14 12:03:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 134/400] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:03:44 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-547707512", "imageRef": "3e365d0f-5c6c-4685-b457-90f08aed34f3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1755081879", "networks": [{"uuid": "c96cae42-6598-4610-a86f-165acef484f3"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] validate_networks() for [('c96cae42-6598-4610-a86f-165acef484f3', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Getting quotas for user 2eb32a03e7e04da18568294cca0e69bd and project cd9936aa363942f6a01bb64a8a8e74c9. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:03:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e365d0f-5c6c-4685-b457-90f08aed34f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:03:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6c4d8459-2f10-47db-80d6-dab38ed9beae tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.573720 Apr 14 12:03:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 134/401] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:03:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:03:44 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-94ea3810-e8ed-4d08-9383-bf847d364d44 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:44 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-94ea3810-e8ed-4d08-9383-bf847d364d44 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-94ea3810-e8ed-4d08-9383-bf847d364d44 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:03:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-94ea3810-e8ed-4d08-9383-bf847d364d44 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1252 microversion: 2.1 time: 0.070827 Apr 14 12:03:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 134/402] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:44 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1252 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] Creating event network-changed:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:03:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-afd89604-0505-46cc-9cbd-1a17c4a82860 req-c96f0093-0450-44aa-8d23-954b5e57a923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035867 Apr 14 12:03:47 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:03:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-3e1fd025-79af-47be-a0d2-69d2d4a18cb6 req-25b037f5-19f8-40d0-a7f3-b6a48e903ffd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039811 Apr 14 12:03:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:03:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:03:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e584d2fd-ff9a-44f6-bbfa-6036999c3bb7 req-7f4ed8a8-580a-4a3e-a071-a90a90971f99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028839 Apr 14 12:03:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 135/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] [instance: 47955121-a299-4b9b-aa83-0e55cfb52f4b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:03:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] HTTP exception thrown: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Request method failure captured: Apr 14 12:03:58 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b HTTP/1.1 Apr 14 12:03:58 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:03:58 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:03:58 user devstack@n-api.service[61700]: Connection: close Apr 14 12:03:58 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:03:58 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:03:58 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:03:58 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:03:58 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-AnTx8LntEBo_352eNWkHkeZRESdZ9v0wTszQtkbcIRgUCRq00gHyBcUB6OMjChvD3Rxl7KVTNHFlqecKf5Yz97JnLXKW9v6QwfyV6tZpJJ8ieWSL9WZAMZ6A3dAewpXL7OSsTzFd4fBkv4oYndvk8NPVdfSvvhln-8XG-jMmQEgc Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Project-Id: 8d1dde7a2b6d498cbb829c51bfafadee Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d1dde7a2b6d498cbb829c51bfafadee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d1dde7a2b6d498cbb829c51bfafadee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d1dde7a2b6d498cbb829c51bfafadee"}]}] Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Tenant-Id: 8d1dde7a2b6d498cbb829c51bfafadee Apr 14 12:03:58 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1955614665 Apr 14 12:03:58 user devstack@n-api.service[61700]: X-User: tempest-VolumesAdminNegativeTest-1955614665-project-member Apr 14 12:03:58 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:03:58 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:03:58 user devstack@n-api.service[61700]: X-User-Id: 390ba60eb6f3478fb8225976ee516218 Apr 14 12:03:58 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesAdminNegativeTest-1955614665-project-member Apr 14 12:03:58 user devstack@n-api.service[61700]: method: > Apr 14 12:03:58 user devstack@n-api.service[61700]: exception: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. Apr 14 12:03:58 user devstack@n-api.service[61700]: action_args: {'id': '47955121-a299-4b9b-aa83-0e55cfb52f4b'} Apr 14 12:03:58 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. Apr 14 12:03:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:03:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Returning 404 to user: Instance 47955121-a299-4b9b-aa83-0e55cfb52f4b could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:03:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8288d032-c708-439b-8f46-5d8f64702224 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b" status: 404 len: 111 microversion: 2.1 time: 0.031383 Apr 14 12:03:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:03:58 2023] GET /compute/v2.1/servers/47955121-a299-4b9b-aa83-0e55cfb52f4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:03:58 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:58 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:03:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d7780885-ae59-4d28-ab19-9bce84955da2 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] Calling method '.version_select at 0x7f4371848c10>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:03:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d7780885-ae59-4d28-ab19-9bce84955da2 tempest-VolumesAdminNegativeTest-1955614665 tempest-VolumesAdminNegativeTest-1955614665-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331968736" status: 202 len: 0 microversion: 2.1 time: 0.026093 Apr 14 12:03:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:03:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331968736 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:06 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:06 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-00125d57-368f-4584-b845-64bce937f100 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1657 microversion: 2.1 time: 0.163689 Apr 14 12:04:06 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 136/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:06 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:06 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0d79fa62-3296-4653-87cb-c8367a6e138e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1657 microversion: 2.1 time: 0.163322 Apr 14 12:04:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:06 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:08 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-557c9d61-ac8d-427b-b60e-08c29f959b6e tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 200 len: 1537 microversion: 2.1 time: 0.195957 Apr 14 12:04:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:07 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:04:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] Creating event network-changed:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:04:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-f30a9f77-af4b-47e4-9f6a-364ae77a2ce6 req-cafb7418-e3b1-4e15-a71e-d10a748ce246 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031411 Apr 14 12:04:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:10 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f05ee199-76ab-4466-aea0-903350d3069b tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383636 Apr 14 12:04:10 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 138/412] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:04:10 2023] POST /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] [instance: b1b9021d-2463-4267-8cb7-cc1c47d54f77] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] HTTP exception thrown: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Request method failure captured: Apr 14 12:04:16 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 HTTP/1.1 Apr 14 12:04:16 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:04:16 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:04:16 user devstack@n-api.service[61699]: Connection: close Apr 14 12:04:16 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:04:16 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:04:16 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:04:16 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:04:16 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUCbDIEXujwb1zO47rRvxB2JUDIekPJFNwGMu2t2jbabp_Vr85wK4sMJ7QMFUGfh5lIw27Ocf5xOyMGFHd-JnXyTAVLNaWTD7f8EH9jkh8wq9j55GJldHu7uscu5wRgVbaHaoKEGl3aFep36-C0A3vo9KObMdKgS9uxNGEY33yidvUM Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Project-Id: cc91a871a3dc4a5a81f6bac70701177b Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesNegativeTest-992240870 Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc91a871a3dc4a5a81f6bac70701177b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc91a871a3dc4a5a81f6bac70701177b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc91a871a3dc4a5a81f6bac70701177b"}]}] Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesNegativeTest-992240870 Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Tenant-Id: cc91a871a3dc4a5a81f6bac70701177b Apr 14 12:04:16 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesNegativeTest-992240870 Apr 14 12:04:16 user devstack@n-api.service[61699]: X-User: tempest-VolumesNegativeTest-992240870-project-member Apr 14 12:04:16 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:04:16 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:04:16 user devstack@n-api.service[61699]: X-User-Id: 288a3cdba40944e0b3bb945ba21d2f1d Apr 14 12:04:16 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesNegativeTest-992240870-project-member Apr 14 12:04:16 user devstack@n-api.service[61699]: method: > Apr 14 12:04:16 user devstack@n-api.service[61699]: exception: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. Apr 14 12:04:16 user devstack@n-api.service[61699]: action_args: {'id': 'b1b9021d-2463-4267-8cb7-cc1c47d54f77'} Apr 14 12:04:16 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. Apr 14 12:04:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:04:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] Returning 404 to user: Instance b1b9021d-2463-4267-8cb7-cc1c47d54f77 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:04:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c8a019f2-7cab-47f7-b9c6-ee3c99105a4c tempest-VolumesNegativeTest-992240870 tempest-VolumesNegativeTest-992240870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77" status: 404 len: 111 microversion: 2.1 time: 0.028536 Apr 14 12:04:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:16 2023] GET /compute/v2.1/servers/b1b9021d-2463-4267-8cb7-cc1c47d54f77 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-620c4998-6865-46da-97c5-db3e02b72f2f tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052726 Apr 14 12:04:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:04:17 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:04:18 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 HTTP/1.1 Apr 14 12:04:18 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:04:18 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:04:18 user devstack@n-api.service[61700]: Connection: close Apr 14 12:04:18 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:04:18 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:04:18 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:04:18 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:04:18 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:04:18 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:04:18 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:04:18 user devstack@n-api.service[61700]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:04:18 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:04:18 user devstack@n-api.service[61700]: method: > Apr 14 12:04:18 user devstack@n-api.service[61700]: exception: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:04:18 user devstack@n-api.service[61700]: action_args: {'id': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4'} Apr 14 12:04:18 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:04:18 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:04:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:04:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-71b7554e-b414-4801-a9c4-be75f1f9028d tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 404 len: 111 microversion: 2.20 time: 0.056205 Apr 14 12:04:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 139/415] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:04:18 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:04:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-624b2927-06fd-4bd3-ba1e-8831fc5e53c7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '.version_select at 0x7f4371953ac0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-624b2927-06fd-4bd3-ba1e-8831fc5e53c7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689899826" status: 204 len: 0 microversion: 2.20 time: 0.024599 Apr 14 12:04:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 139/416] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 12:04:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689899826 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:19 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'services' on Instance uuid ba2689ad-6a47-45c2-b5db-bec9e5a152ac {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:04:19 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-265d8235-d023-47a9-bf90-e101843502e5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: .version_select at 0x7f43719ca950>, body: {"keypair": {"name": "tempest-keypair-230816513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVkEGSeuEZ8Y3htZW1HZinPHvrQPcgejbT/OFh6MfFN2VsnJTbLJi/gTpjMXD41LAKZDrh6KlePbKIa4x2/AbhT90RWYLa4yStEwS5RH7EDrtgqbiBmKAuxLp4/ClApA=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:19 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-265d8235-d023-47a9-bf90-e101843502e5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for project cc13fb093d2745e8ba0152533140b6f2. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:04:19 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-265d8235-d023-47a9-bf90-e101843502e5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for user 260d1d4ef5a1422f84f9d91224b53952 and project cc13fb093d2745e8ba0152533140b6f2. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:04:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9ab27e4e-b95d-405f-b32e-38cf7236eacf tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments/26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9" status: 202 len: 0 microversion: 2.1 time: 0.220713 Apr 14 12:04:19 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:04:19 2023] DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments/26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-265d8235-d023-47a9-bf90-e101843502e5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.087867 Apr 14 12:04:19 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 140/418] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 12:04:19 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 12:04:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d699280e-60ad-4e87-b1da-3e7d07cbc2b9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063894 Apr 14 12:04:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:04:19 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7", "device": "/dev/vdb"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b0576ecf-f7e2-4cf4-8117-283356f981aa tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318819 Apr 14 12:04:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 140/420] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:04:20 2023] POST /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-abbbe395-0ffb-4fee-a6fe-baf29e6ac671 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1504 microversion: 2.1 time: 0.229671 Apr 14 12:04:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 141/421] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:20 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7fdd5521-fe97-4fc0-8559-a480a3ffdb53 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '.version_select at 0x7f4371952680>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:21 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-549197077", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6c442217-393f-4d6e-af13-517003dddfa2"}], "security_groups": [{"name": "tempest-securitygroup--398315770"}], "key_name": "tempest-keypair-230816513", "user_data": "}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7fdd5521-fe97-4fc0-8559-a480a3ffdb53 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9" status: 204 len: 0 microversion: 2.1 time: 0.264541 Apr 14 12:04:21 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:21 2023] DELETE /compute/v2.1/images/d4a621c0-2cd8-43d1-9ce1-86953bcc79e9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:04:21 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] validate_networks() for [('6c442217-393f-4d6e-af13-517003dddfa2', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:04:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ecd23668-1c67-42bd-8c04-e1238a1d65c8 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 204 len: 0 microversion: 2.1 time: 0.151618 Apr 14 12:04:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:04:21 2023] DELETE /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2c1e52acc8496f8f56c82fbce51105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3564d4d9634e469520a3deebe14ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ac3e4b25-b8ed-4f34-a712-71429524c1fd tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 200 len: 1678 microversion: 2.1 time: 0.341858 Apr 14 12:04:21 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:21 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-unplugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] Creating event network-vif-unplugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:04:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ff4fbf6e-1911-497e-a4ef-9b31a05dbd0f req-05fd32f9-8623-4d57-a291-9b80d043b81d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038757 Apr 14 12:04:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 143/425] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for project cc13fb093d2745e8ba0152533140b6f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Getting quotas for user 260d1d4ef5a1422f84f9d91224b53952 and project cc13fb093d2745e8ba0152533140b6f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:04:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:04:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-544e1c3d-19af-46b6-9b77-2fdaaf22415f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.896690 Apr 14 12:04:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 141/426] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 12:04:21 2023] POST /compute/v2.1/servers => generated 399 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 14 12:04:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:22 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:22 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:22 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:22 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:22 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-82a5be4b-85b4-4bba-b092-6528f6a51c6c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1274 microversion: 2.20 time: 0.088222 Apr 14 12:04:22 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 143/427] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:04:22 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:04:24 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-plugged", "status": "completed", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}, {"server_uuid": "80b9c47d-7dc8-4bbe-b961-41921a457d98", "name": "network-vif-deleted", "tag": "00a245fe-c22c-48a0-9718-72e81d0ef026"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Creating event network-vif-plugged:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:04:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] Creating event network-vif-deleted:00a245fe-c22c-48a0-9718-72e81d0ef026 for instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 on user Apr 14 12:04:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-52292786-2897-47d3-a3ec-694714965194 req-160d31a5-6b1d-45ee-8d5f-e22abe3744d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032218 Apr 14 12:04:24 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 144/428] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-facf956e-90f5-4312-bfc9-ceb63915fa10 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Action: 'create', calling method: .version_select at 0x7f437160b5b0>, body: {"keypair": {"name": "tempest-keypair-1300651092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwvNK99UVRoZeGKk1C2aKDber+NGXwjSb1OF7CVugl+yUKmkGvJI0M5s8sT36aK2k1pNTrMWaY3J39RsxSA0phyvF4PsH3ppSI9HKHL4P2z4EBsY+MbMNsbgNVmcGY86Q=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:25 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-facf956e-90f5-4312-bfc9-ceb63915fa10 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting quotas for project a1020d6403b140d7bd28467afcabf8ae. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:04:25 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-facf956e-90f5-4312-bfc9-ceb63915fa10 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting quotas for user e6bb5d52609d47e38856a32e3b847bc6 and project a1020d6403b140d7bd28467afcabf8ae. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:04:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-facf956e-90f5-4312-bfc9-ceb63915fa10 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.050128 Apr 14 12:04:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 142/429] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 12:04:25 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 12:04:26 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:26 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:26 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:26 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] Creating event network-changed:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:04:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-9569daab-f392-4dba-8fca-a22a29d5f6bd req-ea7f8a91-99d2-4219-8b19-538e4a6762ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053884 Apr 14 12:04:26 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 144/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-768440337", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e6d019aa-3803-406f-ae9f-ef1909499d79"}], "security_groups": [{"name": "tempest-securitygroup--438246378"}], "key_name": "tempest-keypair-1300651092", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:27 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] validate_networks() for [('e6d019aa-3803-406f-ae9f-ef1909499d79', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:04:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:04:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:04:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-6e69051a-401e-4a39-8116-032b213347be req-99092c3c-e50e-495c-9601-e05e0950ce44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037274 Apr 14 12:04:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 143/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting quotas for project a1020d6403b140d7bd28467afcabf8ae. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Getting quotas for user e6bb5d52609d47e38856a32e3b847bc6 and project a1020d6403b140d7bd28467afcabf8ae. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:04:28 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:04:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-871239c9-4096-4144-a9c7-74d315e5a252 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.913783 Apr 14 12:04:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 145/432] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 12:04:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 12:04:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:28 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:28 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:28 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:28 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-254f1e00-da54-4a17-bd25-367a1d41301b tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 200 len: 1320 microversion: 2.49 time: 0.086804 Apr 14 12:04:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:04:28 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 1320 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:04:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] Creating event network-changed:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:04:32 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-5e8c27b6-0084-4ea1-9458-f699396da860 req-84739be0-849e-44e9-8636-f4fc23a0fd92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046308 Apr 14 12:04:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 144/434] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-03cc5f9f-becb-4c07-a71e-cebdbf3fd9b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153/action" status: 202 len: 0 microversion: 2.87 time: 0.233718 Apr 14 12:04:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 146/435] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:04:34 2023] POST /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:34 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=24 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] Creating event network-vif-plugged:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:04:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-1f66ab4a-9dc0-4735-9831-efcf844c9c7c req-5bb423df-c49e-43b6-b38d-2718afdb234e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047792 Apr 14 12:04:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 145/436] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2a815191-c06b-4bf1-8741-a846674371a8 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1763 microversion: 2.87 time: 0.529874 Apr 14 12:04:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 146/437] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:04:34 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1763 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:04:35 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-069c061a-43e4-4672-acd5-4044fe35ffec tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1537 microversion: 2.1 time: 0.364021 Apr 14 12:04:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 147/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:35 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:04:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=10 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-unplugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] Creating event network-vif-unplugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:04:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-b871bf06-0a45-44b0-bf65-e00d31dcc015 req-5fc0fbed-05d0-49eb-883c-6602b943bf59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050359 Apr 14 12:04:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 146/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] Creating event network-vif-plugged:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:04:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-5fd1f019-83ff-4ad0-b26d-201ec29c597e req-ab4a9cb7-358c-4bd4-816a-7e5300ff79b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053653 Apr 14 12:04:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 147/440] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:04:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-5f9147da-63cb-437f-8302-58ca3381b105 req-23e0daf7-9215-454a-8afd-c127c25daa50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037117 Apr 14 12:04:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 148/441] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}, {"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:40 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:04:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:04:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-d4bb8bdd-0ce7-4a62-a853-06c05c526ce5 req-52a8e47b-c727-4c45-9b38-ca153b22d977 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050724 Apr 14 12:04:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=17 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=7 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'services' on Instance uuid 93d16198-833e-4412-99ee-637bcf13624d {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:04:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7e6e1620-834b-438e-970b-ae99a9b10e05 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d/os-volume_attachments/2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7" status: 202 len: 0 microversion: 2.1 time: 0.201879 Apr 14 12:04:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 148/443] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:04:49 2023] DELETE /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d/os-volume_attachments/2869af14-c6fd-4f0d-9fbd-6ca788f8b3f7 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:04:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0c591ddf-45b3-4542-9036-201ce0d428f2 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d" status: 204 len: 0 microversion: 2.1 time: 0.149627 Apr 14 12:04:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 149/444] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:04:49 2023] DELETE /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:49 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:04:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-143ad363-da58-4b85-a1f3-2cb0430a9afe tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d" status: 200 len: 1546 microversion: 2.1 time: 0.193755 Apr 14 12:04:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:04:49 2023] GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:04:51 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "name": "network-vif-unplugged", "status": "completed", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] Creating event network-vif-unplugged:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:04:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-a669c289-2a42-4abf-beaf-d5641451c1b3 req-a9411830-507d-4ae6-ba51-3f7defa39549 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031014 Apr 14 12:04:51 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 149/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:04:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "name": "network-vif-plugged", "status": "completed", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}, {"server_uuid": "93d16198-833e-4412-99ee-637bcf13624d", "name": "network-vif-deleted", "tag": "f31873b1-ecc8-435f-b33b-75410f24a124"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:04:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:04:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:04:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:04:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Creating event network-vif-plugged:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:04:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] Creating event network-vif-deleted:f31873b1-ecc8-435f-b33b-75410f24a124 for instance 93d16198-833e-4412-99ee-637bcf13624d on user Apr 14 12:04:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-605203b6-e8c0-49a2-a002-7386d65f6929 req-6a717cf8-a64a-47b4-a4d3-4a8c24699992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047028 Apr 14 12:04:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 150/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:04:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=7 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5094cd8c-98c1-4189-9056-b2384fe9e490 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045984 Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:05:09 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-cf16576e-0d8c-4c47-bb2d-d1523d551041 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1657 microversion: 2.1 time: 0.155975 Apr 14 12:05:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:09 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1aad796-79f6-420f-99ba-c2d1212ece0c"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b25452e4-6384-46bf-ad18-f916a06166fc tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287347 Apr 14 12:05:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 151/450] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:05:09 2023] POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] [instance: 80b9c47d-7dc8-4bbe-b961-41921a457d98] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:11 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] HTTP exception thrown: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. Apr 14 12:05:11 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Request method failure captured: Apr 14 12:05:11 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 HTTP/1.1 Apr 14 12:05:11 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:05:11 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:05:11 user devstack@n-api.service[61701]: Connection: close Apr 14 12:05:11 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:05:11 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:05:11 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:05:11 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:05:11 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-FIbKENZgeIltI-g6JNsQNUUge3j4V6_ks45CY3k_90imF5NVDgFz4DFoR4FDoF4av7OftESoP-q-Izc7_aKOzK3a0vVKqbJ9WBYnLXDkzbTFduA4UurU6n1Q_qgBfeHfO2ibOyIM2VBwz56-JvZlPBTan1sMzHbPZOeMkA2jib8g Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Project-Id: 1b3564d4d9634e469520a3deebe14ab6 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1361865083 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b3564d4d9634e469520a3deebe14ab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b3564d4d9634e469520a3deebe14ab6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b3564d4d9634e469520a3deebe14ab6"}]}] Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerStableDeviceRescueTest-1361865083 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Tenant-Id: 1b3564d4d9634e469520a3deebe14ab6 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1361865083 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-User: tempest-ServerStableDeviceRescueTest-1361865083-project-member Apr 14 12:05:11 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:05:11 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:05:11 user devstack@n-api.service[61701]: X-User-Id: 6b2c1e52acc8496f8f56c82fbce51105 Apr 14 12:05:11 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerStableDeviceRescueTest-1361865083-project-member Apr 14 12:05:11 user devstack@n-api.service[61701]: method: > Apr 14 12:05:11 user devstack@n-api.service[61701]: exception: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. Apr 14 12:05:11 user devstack@n-api.service[61701]: action_args: {'id': '80b9c47d-7dc8-4bbe-b961-41921a457d98'} Apr 14 12:05:11 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:05:11 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. Apr 14 12:05:12 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Returning 404 to user: Instance 80b9c47d-7dc8-4bbe-b961-41921a457d98 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:05:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8cdf4460-3004-4e53-a303-febed2600626 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98" status: 404 len: 111 microversion: 2.1 time: 0.030908 Apr 14 12:05:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:11 2023] GET /compute/v2.1/servers/80b9c47d-7dc8-4bbe-b961-41921a457d98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:05:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3fa61860-ff6d-43d1-8f8b-2c81ef7490d9 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] Calling method '.version_select at 0x7f437184be20>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3fa61860-ff6d-43d1-8f8b-2c81ef7490d9 tempest-ServerStableDeviceRescueTest-1361865083 tempest-ServerStableDeviceRescueTest-1361865083-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438477400" status: 202 len: 0 microversion: 2.1 time: 0.024930 Apr 14 12:05:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:05:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438477400 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:12 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-370b65ee-b118-4b2d-8bac-59140d8b6d35 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1585 microversion: 2.20 time: 0.170539 Apr 14 12:05:12 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 152/453] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:05:12 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1585 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-438143633"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-31d16616-5285-4c53-9261-84ee81f0fdaa tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/action" status: 202 len: 0 microversion: 2.1 time: 0.914448 Apr 14 12:05:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 151/454] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:05:12 2023] POST /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/action => generated 0 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:17 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c320dde3-7f48-4d59-9a1e-22ac53186588 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1703 microversion: 2.1 time: 0.168315 Apr 14 12:05:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 152/455] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:17 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1703 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-451636587", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: dict_keys(['metadata_items']) {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: dict_keys(['metadata_items']) {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:05:17 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f07babd8-d750-415b-8fc0-4e8d76d79c3e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action" status: 202 len: 1158 microversion: 2.1 time: 0.352478 Apr 14 12:05:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 153/456] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 12:05:17 2023] POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action => generated 1158 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8e81d541-137b-4115-afe3-5a1566cda37b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1731 microversion: 2.1 time: 0.201168 Apr 14 12:05:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:18 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:05:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-808d6e03-4c31-4826-8b99-4989e71ed192 req-4f763b0b-74fd-4a4f-a6bb-8d0db30ee3b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031377 Apr 14 12:05:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 153/458] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:18 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-03102bcb-b9af-4658-a958-aafce4aea042 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 200 len: 1626 microversion: 2.49 time: 0.181715 Apr 14 12:05:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 154/459] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:05:18 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 1626 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:05:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:05:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-8e112719-22e3-482a-a4ea-dccd2822db76 req-30c6ef16-aa8b-47c3-be4c-ce9bac5b0633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045406 Apr 14 12:05:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4275172b-6325-4ff9-8af3-406309b8053e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: .version_select at 0x7f4371849990>, body: {"keypair": {"name": "tempest-keypair-1239489635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChwBqnED/n2nWrN2SoLSMRhqkE84LnQSbYpaeWVgLfUiXzTqQT/5YeOR1ydLbZ836JaTZWc0GepItYuqZ/dHFeEKlQx8bHxyYpEaXK0Bnde9kYWx5+wzLpg/aD1Yl4K9A=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:22 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-4275172b-6325-4ff9-8af3-406309b8053e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for project f042abdcef8f41488e8f4624c2f4970b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:05:22 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-4275172b-6325-4ff9-8af3-406309b8053e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for user 263c47076ee94cfaaa34eff928a36fdd and project f042abdcef8f41488e8f4624c2f4970b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:05:22 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4275172b-6325-4ff9-8af3-406309b8053e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056571 Apr 14 12:05:22 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 154/461] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:05:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1674782637", "imageRef": "98eae243-e785-4a84-b3a6-939da193871d", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1794429979", "security_groups": [{"name": "tempest-secgroup-smoke-261590676"}], "networks": [{"uuid": "322f7f95-663e-4341-af0e-2a66ec4a1c70"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:22 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] validate_networks() for [('322f7f95-663e-4341-af0e-2a66ec4a1c70', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Getting quotas for user e2b8b516910f41ffbb8bbf5f9e3c2ec8 and project cfb2ac7942e1473f88b05de5aa79a3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:05:23 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98eae243-e785-4a84-b3a6-939da193871d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:05:23 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-cac830e1-3099-4513-a8c8-58f8556b4c66 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.718922 Apr 14 12:05:23 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 155/462] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:05:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:05:23 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c8b2ec6f-d2a4-4b43-aa6b-f6aca2196fb3 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:23 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c8b2ec6f-d2a4-4b43-aa6b-f6aca2196fb3 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:23 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-c8b2ec6f-d2a4-4b43-aa6b-f6aca2196fb3 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:23 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c8b2ec6f-d2a4-4b43-aa6b-f6aca2196fb3 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 200 len: 1237 microversion: 2.1 time: 0.085879 Apr 14 12:05:23 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:23 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1425077184", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a732efb0-3274-408d-aabd-725f667bc8f1"}], "security_groups": [{"name": "tempest-securitygroup--375439899"}], "key_name": "tempest-keypair-1239489635", "user_data": "}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:24 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] validate_networks() for [('a732efb0-3274-408d-aabd-725f667bc8f1', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:25 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e6be4b29-5af5-412f-9690-cc33ed7f0055 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1769 microversion: 2.87 time: 0.193347 Apr 14 12:05:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 156/464] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:05:25 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1769 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Getting quotas for user 263c47076ee94cfaaa34eff928a36fdd and project f042abdcef8f41488e8f4624c2f4970b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:05:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:05:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9b999a0e-5f0f-4537-b225-ecd2973c4823 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.592400 Apr 14 12:05:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 155/465] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:05:24 2023] POST /compute/v2.1/servers => generated 406 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:05:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-bfea6be6-e707-4e66-aab7-ab0165435f04 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:26 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-bfea6be6-e707-4e66-aab7-ab0165435f04 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:26 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-bfea6be6-e707-4e66-aab7-ab0165435f04 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-bfea6be6-e707-4e66-aab7-ab0165435f04 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1240 microversion: 2.1 time: 0.102094 Apr 14 12:05:26 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 155/466] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:26 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] Creating event network-changed:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:05:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-832ed9ab-20e9-4814-8154-6538894547e8 req-474031d3-21ee-496d-9c00-bbffce1c6160 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030251 Apr 14 12:05:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] Creating event network-changed:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:05:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f2e0bbe0-58fc-4fc2-91dc-00e44cba91d8 req-6f9e4182-2b37-4896-a98b-a50a5d29f022 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053582 Apr 14 12:05:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 156/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:05:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0014f112-ce4e-4a2c-96de-fcd596d0b28f req-f429bdaf-541c-4916-a9ac-a9e26144b6bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044561 Apr 14 12:05:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 156/469] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:05:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-1625b919-e8ea-4b6e-a0b0-6eb7fde93d2d req-8ea73b5f-eb6e-40db-a1f1-530f09a63610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053486 Apr 14 12:05:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 158/470] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:05:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7bb25d2c-3dbd-4e33-817a-09024788a7e5 req-642f7cb0-baa2-4005-88d6-13bd236b856e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 Apr 14 12:05:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 157/471] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}, {"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:05:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:05:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:05:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-a86598c4-bb85-4fb1-aa92-e438841d85de req-ae422378-8d8d-488d-8335-269d2df1d9dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036936 Apr 14 12:05:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 157/472] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:34 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:35 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e51de8e8-7b07-4fbf-882e-2d0b367b3859 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1537 microversion: 2.1 time: 0.282204 Apr 14 12:05:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:35 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=10 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Searching by: {'deleted': False, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9'} {{(pid=61699) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:36 user devstack@n-api.service[61699]: DEBUG nova.compute.multi_cell_list [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 12:05:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-a909c5ba-a3d1-477e-a6d8-e67315722028 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.336149 Apr 14 12:05:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 158/474] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 12:05:35 2023] GET /compute/v2.1/servers => generated 340 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:36 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2792dd4e-90da-4cc1-9f2e-51d43c597ae6 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1537 microversion: 2.1 time: 0.241706 Apr 14 12:05:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 158/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:36 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b62c6d91-1d0e-42a1-ae0e-68e03d7992d2"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: 93d16198-833e-4412-99ee-637bcf13624d] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=29 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] HTTP exception thrown: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Request method failure captured: Apr 14 12:05:39 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d HTTP/1.1 Apr 14 12:05:39 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:05:39 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:05:39 user devstack@n-api.service[61699]: Connection: close Apr 14 12:05:39 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:05:39 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:05:39 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:05:39 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:05:39 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUDPmx2Fn0Lmxw8i6UnL4fc0SFg-hJlG0YE5fc6du3HjXkPIJx1fIDTEjhsVYCxHmMu0-vYRJEXfy_iDTemceyIBAZo90veIerCboYGbmw8M3O0rZUaQhXc3eqOAIGY5LpZ_eZg4lIE9JMpsxKLXdJh_gYUXHgyo79fSTEK4H8W24xk Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Project-Id: ae5ac6388692423b9bf23bf6be0cb06d Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5ac6388692423b9bf23bf6be0cb06d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5ac6388692423b9bf23bf6be0cb06d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5ac6388692423b9bf23bf6be0cb06d"}]}] Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Tenant-Id: ae5ac6388692423b9bf23bf6be0cb06d Apr 14 12:05:39 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:05:39 user devstack@n-api.service[61699]: X-User: tempest-VolumesSnapshotTestJSON-1634639087-project-member Apr 14 12:05:39 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:05:39 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:05:39 user devstack@n-api.service[61699]: X-User-Id: 61adadbd79ef493889ef3dcb63f63fd8 Apr 14 12:05:39 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesSnapshotTestJSON-1634639087-project-member Apr 14 12:05:39 user devstack@n-api.service[61699]: method: > Apr 14 12:05:39 user devstack@n-api.service[61699]: exception: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. Apr 14 12:05:39 user devstack@n-api.service[61699]: action_args: {'id': '93d16198-833e-4412-99ee-637bcf13624d'} Apr 14 12:05:39 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. Apr 14 12:05:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:05:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Returning 404 to user: Instance 93d16198-833e-4412-99ee-637bcf13624d could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:05:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-603a0383-45db-453e-9396-fc72db6f180f tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d" status: 404 len: 111 microversion: 2.1 time: 0.042965 Apr 14 12:05:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 159/476] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:39 2023] GET /compute/v2.1/servers/93d16198-833e-4412-99ee-637bcf13624d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:05:39 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=7,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e350b4c8-1e7e-4f12-9ca5-edd8ec34c90b tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403981 Apr 14 12:05:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 160/477] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:05:39 2023] POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=24 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:47 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ea9519a6-0d32-4217-bdcf-d91dbd31b7c3 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1583 microversion: 2.1 time: 0.199593 Apr 14 12:05:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 159/478] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:47 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1583 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] Creating event network-changed:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:05:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-016ccfe8-8f0d-43b6-8a0b-24023cdf40fb req-98a78fbe-c9c0-428a-9275-79a5b647a5bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033766 Apr 14 12:05:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 160/479] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1739299377"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:51 user devstack@n-api.service[61700]: INFO nova.network.security_group_api [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Adding security group d03bbfcf-bef8-436a-9b1e-7cebedc48d89 to port a8047706-f64e-47f2-bb99-b1e66dbd2df8 Apr 14 12:05:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-95f07f42-d4a1-45da-8489-8b20aa2e1ad8 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action" status: 202 len: 0 microversion: 2.1 time: 0.698238 Apr 14 12:05:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 161/480] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:05:51 2023] POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] Creating event network-changed:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:05:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-6d6f213f-3310-421e-948a-737eeac94c03 req-a44bf0dd-0978-4fea-8c1b-08b88c2adbd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045113 Apr 14 12:05:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 160/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:52 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e8459e36-c0b6-4c73-8b3f-ca72ce06381e tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1748 microversion: 2.1 time: 0.215642 Apr 14 12:05:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 161/482] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:52 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1748 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2cb185ea-56a2-4d76-80fb-0cb5e1a25040 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action" status: 202 len: 0 microversion: 2.1 time: 0.098437 Apr 14 12:05:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 162/483] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:05:52 2023] POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:53 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-15b1f402-86c1-46c5-9f2a-671ecd6809af tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1740 microversion: 2.1 time: 0.287040 Apr 14 12:05:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 161/484] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:52 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1254198979", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "c4fb3dc6-20fb-4fce-ac17-7c676652dfe8"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:54 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] validate_networks() for [('c4fb3dc6-20fb-4fce-ac17-7c676652dfe8', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting quotas for project ae5ac6388692423b9bf23bf6be0cb06d. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Getting quotas for user 61adadbd79ef493889ef3dcb63f63fd8 and project ae5ac6388692423b9bf23bf6be0cb06d. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:05:55 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:05:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8d215443-d2c1-4789-8b02-93b5494962e5 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.587499 Apr 14 12:05:55 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 162/485] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:05:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:05:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2814efe8-22dd-4ae2-afab-867121c23215 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:05:55 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2814efe8-22dd-4ae2-afab-867121c23215 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:05:55 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-2814efe8-22dd-4ae2-afab-867121c23215 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:05:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2814efe8-22dd-4ae2-afab-867121c23215 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" status: 200 len: 1213 microversion: 2.1 time: 0.400065 Apr 14 12:05:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 163/486] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:05:55 2023] GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => generated 1213 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:05:56 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-unplugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:56 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] Creating event network-vif-unplugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:05:56 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-99650bd8-0d64-4cb8-a6e4-2b84927f62c2 req-7423bfca-d8ed-4e13-af77-ecbf9d6efda7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033992 Apr 14 12:05:56 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 162/487] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:05:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}, {"name": "network-changed", "server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:05:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:05:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:05:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:05:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:05:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] Creating event network-changed:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:05:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-e7c09621-9953-4979-9cad-8020f79499f4 req-1a8bd474-2e6b-400a-8ae8-7b8eb8b256a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043942 Apr 14 12:05:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 163/488] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}, {"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:06:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:06:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:06:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-0a6d2e82-5df5-4276-89de-911d5ed53c3a req-2a5be66d-c98c-4994-831e-3740cdb8f08b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038534 Apr 14 12:06:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 164/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-f8d3f246-ae3c-42fd-84af-027aacf25a65 req-8f728597-3fb3-4625-a1f9-7ddab4ac8ddd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Apr 14 12:06:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:06:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2d48eddc-682b-4eab-b46b-1349dae49b86 req-416c342d-1900-4360-ad32-b83aa2b8eb4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045370 Apr 14 12:06:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 164/491] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:08 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9b48e6aa-40b5-4060-b9d0-e174c53bfafa tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.149720 Apr 14 12:06:08 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 165/492] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:06:08 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=10 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=18 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dd30d4f4-2e82-4655-b48b-0a4c76d5134c tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.091865 Apr 14 12:06:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 164/493] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 12:06:12 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=14 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] Creating event network-changed:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-36d8e58d-6a13-4153-81ff-182d17865d51 req-2d562d48-a77f-4c25-96d4-ebd4e17fb49e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046915 Apr 14 12:06:13 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 165/494] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-dc3e75d1-c376-4b0a-b62a-928259b345ad tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/ips" status: 200 len: 110 microversion: 2.20 time: 0.039328 Apr 14 12:06:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 165/495] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 12:06:13 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:13 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2ab6d335-214d-47b5-95af-2b631769980f tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 200 len: 1537 microversion: 2.1 time: 0.170788 Apr 14 12:06:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 166/496] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:06:13 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:16 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lazy-loading 'flavor' on Instance uuid 5181aed1-2933-4b33-893e-eb30a0d4ff4c {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:06:16 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7977d226-bfb0-4412-8f18-df71dac41e63 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1554 microversion: 2.1 time: 0.172188 Apr 14 12:06:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 166/497] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:06:16 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:06:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5efd73f5-96c9-4539-a551-75e09d527df6 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/action" status: 202 len: 0 microversion: 2.20 time: 0.958898 Apr 14 12:06:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 166/498] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:06:16 2023] POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:17 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7685380e-bf17-4635-94d3-e3aa606fc508 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1710 microversion: 2.20 time: 0.197144 Apr 14 12:06:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 167/499] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:06:17 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:06:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-unplugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] Creating event network-vif-unplugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-0c19b613-3963-41fe-99a1-a45cc291e4ec req-9e8a711e-cf9d-4850-b271-56ac67da8243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048498 Apr 14 12:06:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 167/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d444dae8-dec7-4d84-addd-86eadc9b07af tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.104403 Apr 14 12:06:19 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 167/501] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 12:06:19 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:19 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-unplugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Creating event network-vif-unplugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7aeb256c-182d-452e-a3e1-921acbecf75b req-3db97074-8c69-4cea-b7cb-40ac958e7c95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037558 Apr 14 12:06:19 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 168/502] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:19 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] Creating event network-changed:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-98033c0b-22d8-45a9-9d97-dedfc51a32d0 req-b5e6aa54-9d21-4113-82e7-969b80f7ecf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Apr 14 12:06:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 168/503] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:20 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4f817c46-3ae3-49ea-823f-5c6b99759eb8 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 200 len: 1626 microversion: 2.49 time: 0.316855 Apr 14 12:06:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 168/504] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:06:20 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 1626 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "47a303ab-2823-4049-89ed-7ceeb77b4162", "tag": "nic-tag"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] Creating event network-changed:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:06:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6bb380cf-5d2b-49b5-be88-e36745452802 req-b76b7d62-70e9-4158-b96b-82848de9414f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041909 Apr 14 12:06:23 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 169/505] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=21 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3b1620ab-7bbc-42b2-ae4d-664cdb416647 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface" status: 200 len: 282 microversion: 2.49 time: 4.867530 Apr 14 12:06:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 169/506] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 12:06:20 2023] POST /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface => generated 282 bytes in 4869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "798cf245-59e4-4a38-8e64-1cc8a807bf31", "tag": "volume-tag"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:25 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}, {"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}, {"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Creating event network-changed:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Creating event network-vif-plugged:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] Creating event network-vif-plugged:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b79fe571-4ef5-41ab-8d6b-e4dde7c36b2d req-124b7394-3283-4739-b8ec-22c08eb6ec41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.031971 Apr 14 12:06:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 170/507] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-247540869", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "609095b3-aa7f-45b1-a300-792fe3c6435a"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:25 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] validate_networks() for [('609095b3-aa7f-45b1-a300-792fe3c6435a', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:06:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-04694cc7-ea3e-4fc7-882c-54a2f34c7d0e tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.487714 Apr 14 12:06:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 169/508] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 12:06:25 2023] POST /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for user 11df88c60e4b456691d8731fe8facf38 and project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:06:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:06:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e049d330-3ef2-4db8-ac9d-768f6356c0ee tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.529745 Apr 14 12:06:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 170/509] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 12:06:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 12:06:26 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:26 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:26 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:26 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:26 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d153cfb3-e342-4364-ac43-899ed0f926dc tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 200 len: 1394 microversion: 2.87 time: 0.076814 Apr 14 12:06:26 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 171/510] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:06:26 2023] GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 1394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:06:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] Creating event network-changed:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:06:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-2f478021-51f7-4ac7-88c2-bc6079fd6e68 req-2477ebf7-d843-419b-85a1-f9d0de5a8faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058508 Apr 14 12:06:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 170/511] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:06:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "name": "network-vif-plugged", "status": "completed", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] Creating event network-vif-plugged:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:06:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-53cffac8-1b3c-47d1-952e-6ef67486985b req-dc3e7360-82f4-45dd-9e0f-e773dd3a2210 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058764 Apr 14 12:06:31 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 171/512] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:33 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "name": "network-vif-plugged", "status": "completed", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] Creating event network-vif-plugged:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:06:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-104988e9-4e6c-4b03-a710-13f718516168 req-04a06150-c810-458d-a460-d8b90f6cf04d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Apr 14 12:06:33 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 172/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:34 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lazy-loading 'services' on Instance uuid 8f409eb4-2ec5-4481-9cef-5524ec2ae58b {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:06:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-887e49d8-5dac-434d-b485-a742276919b7 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments/798cf245-59e4-4a38-8e64-1cc8a807bf31" status: 202 len: 0 microversion: 2.49 time: 0.359403 Apr 14 12:06:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 171/514] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 12:06:33 2023] DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments/798cf245-59e4-4a38-8e64-1cc8a807bf31 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e70fff7f-82da-485b-b3ad-408353c7d69d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface/2c916396-3333-46ee-bd7f-3476c2980e51" status: 202 len: 0 microversion: 2.49 time: 0.082135 Apr 14 12:06:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 172/515] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 12:06:36 2023] DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-interface/2c916396-3333-46ee-bd7f-3476c2980e51 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ced2cd95-d1b8-41f3-ae3f-3b29415fba82 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d" status: 200 len: 474 microversion: 2.49 time: 0.328503 Apr 14 12:06:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 173/516] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 12:06:36 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d => generated 474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:06:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-unplugged", "status": "completed", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] Creating event network-vif-unplugged:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-6380f43c-38a8-41f7-9f4c-1d451f7801d0 req-66401a54-2db7-4dca-95fb-0926ae95786e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032882 Apr 14 12:06:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 172/517] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}, {"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-deleted", "tag": "2c916396-3333-46ee-bd7f-3476c2980e51"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:06:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Creating event network-vif-plugged:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] Creating event network-vif-deleted:2c916396-3333-46ee-bd7f-3476c2980e51 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:06:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-5ab70bfa-93f1-4ce0-ae4b-2eaf8145cc6b req-5ead7771-39e3-40ff-9c88-0d4fefe9b74e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031893 Apr 14 12:06:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 173/518] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:43 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4ec6b299-890a-4487-a69e-6af9ad37c474 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1748 microversion: 2.1 time: 0.329649 Apr 14 12:06:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 174/519] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:06:43 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1748 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:06:45 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:06:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-0a802324-2ad8-43ae-930c-7a4945222bfb tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" status: 200 len: 1494 microversion: 2.1 time: 0.180976 Apr 14 12:06:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 173/520] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:06:45 2023] GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-179c89cf-8bf6-46a6-9437-eb062c414429 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1651 microversion: 2.20 time: 0.421674 Apr 14 12:07:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 174/521] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:07:07 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1651 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=24 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=32 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:08 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-27a1cebb-9ef9-49aa-b245-b97449d472ea tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.279377 Apr 14 12:07:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 175/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:07:08 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=5 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:09 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5d1aeeae-dd90-4f7f-82c3-e349a680a852 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.373633 Apr 14 12:07:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 174/523] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:07:09 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:14 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:14 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c0c97039-d4f1-4de3-8f61-ba50c67908c9 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 200 len: 1537 microversion: 2.1 time: 0.375677 Apr 14 12:07:14 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 175/524] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:07:13 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 1537 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] Creating event network-changed:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:07:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-c0368a9c-a872-4cb6-a571-80d93f3d534a req-1ed2e3f0-a143-4ded-bc8b-0be1375d9673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048839 Apr 14 12:07:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 176/525] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35ffe4be-2c3f-4432-a2c9-893e9a1914c2"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-79347306-e7c1-4146-a2e9-cadebcae05f6 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316504 Apr 14 12:07:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 175/526] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:07:15 2023] POST /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-da5f2854-35a3-49ee-b875-b71473b3c180 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 200 len: 1690 microversion: 2.87 time: 0.168992 Apr 14 12:07:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 176/527] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:07:16 2023] GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 12:07:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ad0c380c-d3a7-4fd4-a007-cb316fce9553 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.156225 Apr 14 12:07:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 177/528] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:07:16 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-interface => generated 283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "456eefe5-dfcc-43aa-bb82-87ee292ece79"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d2b8c351-3715-4a7e-8f2b-5396096afbdd tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339374 Apr 14 12:07:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 176/529] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:07:17 2023] POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] Creating event network-changed:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:07:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-4d46a820-9a29-49f3-af20-c8a89176a42b req-ef3d9b37-26cb-4770-84c8-537ecde024d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054552 Apr 14 12:07:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 177/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:24 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lazy-loading 'services' on Instance uuid b79d8978-9bc5-4a22-98cf-025f949dc1bc {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:07:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c0e5a5c2-b7a2-43d8-bb00-57ae72e4e951 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments/35ffe4be-2c3f-4432-a2c9-893e9a1914c2" status: 202 len: 0 microversion: 2.1 time: 0.201569 Apr 14 12:07:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 178/531] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:07:24 2023] DELETE /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments/35ffe4be-2c3f-4432-a2c9-893e9a1914c2 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:24 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5d6ca99b-2852-4098-ba09-74dba8be3975 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049665 Apr 14 12:07:24 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:07:24 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:25 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'flavor' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:07:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-116e166a-bd2f-4703-9ec2-c9cfe202ee94 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/action" status: 200 len: 32 microversion: 2.1 time: 0.179479 Apr 14 12:07:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 178/533] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:07:25 2023] POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:26 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e0dae355-3e80-4e69-8c6c-b802cc36cc25 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1725 microversion: 2.1 time: 0.155263 Apr 14 12:07:26 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 179/534] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:07:25 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] Creating event network-vif-unplugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:07:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-2113bb45-312c-4a34-aff1-e84d7759a046 req-bab0814a-77cc-4726-8f4d-7e16cec05ee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085095 Apr 14 12:07:26 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 178/535] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-661642535", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "aa09e440-819f-4288-8b93-8a236ed86b53", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3ca88ffb-c265-4c68-9bf2-54d81c0ae126 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d" status: 200 len: 503 microversion: 2.49 time: 0.097777 Apr 14 12:07:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 179/536] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 12:07:26 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d => generated 503 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:07:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-869f9195-a1c9-419d-8642-517486fe6c84 tempest-TaggedAttachmentsTest-291171595 tempest-TaggedAttachmentsTest-291171595-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d" status: 200 len: 503 microversion: 2.49 time: 0.068299 Apr 14 12:07:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 179/537] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 12:07:27 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-instance-actions/req-e70fff7f-82da-485b-b3ad-408353c7d69d => generated 503 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-674b64b3-3935-4e29-9a4f-93980b835d7d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.061064 Apr 14 12:07:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 180/538] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 12:07:27 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:07:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8aae3379-11e8-4a74-b5dc-8cebb91b9198 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 204 len: 0 microversion: 2.49 time: 0.138782 Apr 14 12:07:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 180/539] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:07:27 2023] DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:07:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='aa09e440-819f-4288-8b93-8a236ed86b53',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:27 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6bb5d52609d47e38856a32e3b847bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1020d6403b140d7bd28467afcabf8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-312fccf3-5e78-4fe8-a8cb-6dc97a6e5c13 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 200 len: 1751 microversion: 2.49 time: 0.200326 Apr 14 12:07:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 181/540] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:07:27 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4feb46b8-52da-465d-86d3-d6b47fe0f50f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.746267 Apr 14 12:07:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 180/541] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:07:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b3839c4c-c2e1-4c1d-b652-1705694247f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b3839c4c-c2e1-4c1d-b652-1705694247f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:27 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-b3839c4c-c2e1-4c1d-b652-1705694247f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:07:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b3839c4c-c2e1-4c1d-b652-1705694247f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 200 len: 1051 microversion: 2.1 time: 0.076026 Apr 14 12:07:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 181/542] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:07:27 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 1051 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:07:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}, {"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-unplugged", "status": "completed", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}, {"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-plugged", "status": "completed", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:07:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Creating event network-vif-unplugged:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:07:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] Creating event network-vif-plugged:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:07:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-3f183057-1d0e-4022-8632-9548388ecb3b req-6c96740e-0685-42c8-9902-9aad6f7d9f50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035092 Apr 14 12:07:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 182/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f409eb4-2ec5-4481-9cef-5524ec2ae58b", "name": "network-vif-deleted", "tag": "4eea14b0-9a05-4eb6-a383-586a5eeb0622"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] Creating event network-vif-deleted:4eea14b0-9a05-4eb6-a383-586a5eeb0622 for instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b on user Apr 14 12:07:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-acf08a4c-d86e-4fad-8f49-ed76b535333a req-40d33056-4421-427a-9bf1-023854d9a336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099793 Apr 14 12:07:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 181/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}, {"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:07:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:07:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-3e00bc8c-042e-461c-a2d4-dc688500d4af req-ab874388-c60e-43a6-88fe-6c8dd00efb71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052942 Apr 14 12:07:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 182/545] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] Creating event network-changed:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:07:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-784dcd25-a380-4606-b9d2-6d779cb64c39 req-74f9181c-62a8-4e5a-b8fd-c73b8e05e319 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027964 Apr 14 12:07:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 183/546] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "name": "network-vif-plugged", "status": "completed", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:42 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:42 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] Creating event network-vif-plugged:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:07:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-1bfd974c-2aee-4df6-86c6-f33c5e2c61ef req-acf936aa-59dd-4e4c-816b-b82910573d32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069726 Apr 14 12:07:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 182/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1739299377"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:43 user devstack@n-api.service[61701]: INFO nova.network.security_group_api [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Removing security group d03bbfcf-bef8-436a-9b1e-7cebedc48d89 from port a8047706-f64e-47f2-bb99-b1e66dbd2df8 Apr 14 12:07:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-030170a8-ad52-4831-b78c-d98a6cc41354 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action" status: 202 len: 0 microversion: 2.1 time: 0.605530 Apr 14 12:07:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 183/548] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:07:43 2023] POST /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=22 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] Creating event network-changed:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:07:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-c37c2a61-eb62-4a4d-a2cc-1d4174ac6ca7 req-09533ea0-286c-424f-b891-afb455a43f45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040102 Apr 14 12:07:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 184/549] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "name": "network-vif-plugged", "status": "completed", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] Creating event network-vif-plugged:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:07:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-87e65840-b9e4-41ea-91c1-2f2cc129a58c req-241e3e30-eb73-4385-a7e9-756d2bb9cef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033139 Apr 14 12:07:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 183/550] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:45 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lazy-loading 'services' on Instance uuid 075f81e9-8b43-4b05-96be-6eb4cca6d812 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:07:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b132ecbc-e97f-47a4-ba0f-78f42274e9e5 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments/b62c6d91-1d0e-42a1-ae0e-68e03d7992d2" status: 202 len: 0 microversion: 2.1 time: 0.374977 Apr 14 12:07:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 184/551] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:07:45 2023] DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments/b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9a8ec01c-d636-43fe-be67-f9570f439a17 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 Apr 14 12:07:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 184/552] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:07:45 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84a69785-51a3-45bb-b21b-8a2e95aea8bc", "device": "/dev/vdb"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0cc3d0fa-8b48-47f2-9643-0dec1a6a4032 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429544 Apr 14 12:07:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 185/553] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:07:45 2023] POST /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:07:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:07:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:07:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:07:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:07:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] Creating event network-changed:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:07:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e1049b26-0622-4ff5-8a91-e66ee835e5c4 req-653a1b17-b43a-4f0c-ab1d-604e94779c37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Apr 14 12:07:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 185/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:07 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:07 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=10 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89c6ade6-af4f-4b98-93b0-6de0159e1557"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-15083fbd-9848-45e3-a852-16a3d437b272 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.464338 Apr 14 12:08:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 185/555] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 12:08:07 2023] POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments => generated 188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-93958d63-35c5-46b9-bd0e-269b117107f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments/89c6ade6-af4f-4b98-93b0-6de0159e1557" status: 202 len: 0 microversion: 2.20 time: 0.245281 Apr 14 12:08:08 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 186/556] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 12:08:08 2023] DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments/89c6ade6-af4f-4b98-93b0-6de0159e1557 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:08 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61701) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 12:08:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-479c82f1-0f1e-4c4a-a85c-e43dab0b8288 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/action" status: 202 len: 0 microversion: 2.20 time: 0.120211 Apr 14 12:08:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 186/557] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:08:08 2023] POST /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:09 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-71d44c04-1f73-4a04-896a-7261caa9871f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1659 microversion: 2.20 time: 0.185687 Apr 14 12:08:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 186/558] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:08:09 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1659 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lazy-loading 'services' on Instance uuid 11e4aa91-7c03-46cc-8610-78f18bbd089f {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:08:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f7d447aa-9829-4363-a772-ab427ef1eda1 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments/c1aad796-79f6-420f-99ba-c2d1212ece0c" status: 202 len: 0 microversion: 2.1 time: 0.175910 Apr 14 12:08:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:08:09 2023] DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments/c1aad796-79f6-420f-99ba-c2d1212ece0c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ccefa067-488d-4e35-b808-04b112a841b7 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052691 Apr 14 12:08:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 187/560] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:08:09 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lazy-loading 'services' on Instance uuid bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:08:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-83404733-40e6-4131-a439-e8e04a5462da tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/os-volume_attachments/84a69785-51a3-45bb-b21b-8a2e95aea8bc" status: 202 len: 0 microversion: 2.1 time: 0.209714 Apr 14 12:08:10 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 187/561] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:08:10 2023] DELETE /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649/os-volume_attachments/84a69785-51a3-45bb-b21b-8a2e95aea8bc => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:08:10 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-4cac3d74-3f37-41c7-adc9-28992e00e0ba tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" status: 204 len: 0 microversion: 2.1 time: 0.141622 Apr 14 12:08:10 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 188/562] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:08:10 2023] DELETE /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:10 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61adadbd79ef493889ef3dcb63f63fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5ac6388692423b9bf23bf6be0cb06d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:10 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-967077e3-784b-4724-9d88-36e6f0705e69 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" status: 200 len: 1546 microversion: 2.1 time: 0.197702 Apr 14 12:08:10 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 188/563] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:08:10 2023] GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:11 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] Creating event network-changed:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:08:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-14c826c2-84a6-4937-9a83-3a3aa57fb51d req-bb7ea1d6-25c4-4b85-9165-b4a41e159b3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030232 Apr 14 12:08:11 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 188/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-unplugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] Creating event network-vif-unplugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-f03d39a8-6bc8-483f-b4a2-3cc3e8fb1cd2 req-8235bcba-9bbf-43c7-93db-079974132c82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028581 Apr 14 12:08:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 189/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-deleted", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] Creating event network-vif-deleted:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e026209e-dcee-4bd1-8753-054cec2b325d req-1cc55a0c-7fff-4290-b8b5-7c79c485a0d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037090 Apr 14 12:08:14 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 189/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4fb2b580-0b54-4553-8f9a-1c09b6ddcd37 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056617 Apr 14 12:08:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 189/567] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:08:14 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}, {"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}, {"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}, {"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-unplugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}, {"server_uuid": "bf72b2ec-5763-47e9-b9a8-b0cf9df9d649", "name": "network-vif-plugged", "status": "completed", "tag": "2f1bec16-15b5-414a-aeb9-19c6e8694096"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Creating event network-vif-unplugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] Creating event network-vif-plugged:2f1bec16-15b5-414a-aeb9-19c6e8694096 for instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 on user Apr 14 12:08:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-089f5648-e01a-4866-9082-2267db23855a req-8655dc7e-0083-41ef-ac5f-70fe5dc1be23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.049001 Apr 14 12:08:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:15 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:08:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] Creating event network-changed:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-3c72153f-8f19-4713-acdd-de82226deb53 req-968451bd-d918-4319-be19-b2306622aba1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117714 Apr 14 12:08:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 190/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d353f80b-81a8-4710-a7f8-2be50ba0db29 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 204 len: 0 microversion: 2.1 time: 0.145510 Apr 14 12:08:15 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 190/570] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:08:15 2023] DELETE /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-01a57552-35d9-4225-aa72-bfe4545e1504 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 200 len: 1662 microversion: 2.1 time: 0.244050 Apr 14 12:08:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 191/571] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:08:15 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 1662 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:16 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-54ccb000-a584-4858-bb8c-de25b3bf7a11 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1705 microversion: 2.1 time: 0.401866 Apr 14 12:08:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 191/572] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:08:16 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1705 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-107105463"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-deleted", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] Creating event network-vif-deleted:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-6dd0ed64-1aa2-4e92-947b-bfe48cd696d3 req-492186a1-fb1e-421c-88c5-5272b5ca3230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031202 Apr 14 12:08:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 192/573] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] HTTP exception thrown: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Request method failure captured: Apr 14 12:08:17 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b HTTP/1.1 Apr 14 12:08:17 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:08:17 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:08:17 user devstack@n-api.service[61699]: Connection: close Apr 14 12:08:17 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:08:17 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:08:17 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:08:17 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:08:17 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUE9TfIjUE-gnso72rpLNQY_Ap6i1zF7nt_Bft6MbE2uSMleFcVZ3_9zM_L59jvk87ee4E3qaTIzFQMTjrOLeJYSDRtsHQrqUzkT9WYJK0k3fXUmtXmgKp9Ek_2bUNCdDRPOFSGjA7GR6JuJbQliyYMSP8ihkHGoriMLQ_qBDbdWBoM Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Project-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Project-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1020d6403b140d7bd28467afcabf8ae"}]}] Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Tenant: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Tenant-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:17 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-User: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:17 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:08:17 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:08:17 user devstack@n-api.service[61699]: X-User-Id: e6bb5d52609d47e38856a32e3b847bc6 Apr 14 12:08:17 user devstack@n-api.service[61699]: X-User-Name: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:17 user devstack@n-api.service[61699]: method: > Apr 14 12:08:17 user devstack@n-api.service[61699]: exception: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:17 user devstack@n-api.service[61699]: action_args: {'id': '8f409eb4-2ec5-4481-9cef-5524ec2ae58b'} Apr 14 12:08:17 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:17 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Returning 404 to user: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-75caa37b-a31d-4012-897b-fff56b253dc1 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 404 len: 111 microversion: 2.49 time: 0.030484 Apr 14 12:08:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 192/574] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:08:17 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f145c1dd-0b9d-485c-a076-f5248372c319 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '.version_select at 0x7f437187c670>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f145c1dd-0b9d-485c-a076-f5248372c319 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300651092" status: 204 len: 0 microversion: 2.49 time: 0.022789 Apr 14 12:08:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 193/575] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 12:08:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300651092 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:08:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-06654ef8-03d1-44ce-a806-444211ec99ef tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd/action" status: 202 len: 52 microversion: 2.87 time: 1.210699 Apr 14 12:08:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 191/576] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:08:16 2023] POST /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd/action => generated 52 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-unplugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}, {"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}, {"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}, {"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}, {"server_uuid": "b79d8978-9bc5-4a22-98cf-025f949dc1bc", "name": "network-vif-plugged", "status": "completed", "tag": "4f8abc87-2a83-454a-9a91-eebcf782364e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Creating event network-vif-unplugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] Creating event network-vif-plugged:4f8abc87-2a83-454a-9a91-eebcf782364e for instance b79d8978-9bc5-4a22-98cf-025f949dc1bc on user Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b1aaaa7a-7c52-41b4-8506-3f5d2e2cc49f req-806bc035-6778-4e0e-9ba2-fdb491862afa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034220 Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 193/577] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:17 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:18 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a02ba343-01ac-4797-8c21-d5bc9c91eb83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 200 len: 1377 microversion: 2.1 time: 0.185376 Apr 14 12:08:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 194/578] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:08:17 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 1377 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:08:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:08:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-285f676a-5adb-47a6-b6bf-3e22ff718180 req-4a5cd2d8-db2e-4ecb-a7d4-668892e660f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044968 Apr 14 12:08:19 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 192/579] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] HTTP exception thrown: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Request method failure captured: Apr 14 12:08:19 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b HTTP/1.1 Apr 14 12:08:19 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:08:19 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:08:19 user devstack@n-api.service[61699]: Connection: close Apr 14 12:08:19 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:08:19 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:08:19 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:08:19 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:08:19 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUE9TfIjUE-gnso72rpLNQY_Ap6i1zF7nt_Bft6MbE2uSMleFcVZ3_9zM_L59jvk87ee4E3qaTIzFQMTjrOLeJYSDRtsHQrqUzkT9WYJK0k3fXUmtXmgKp9Ek_2bUNCdDRPOFSGjA7GR6JuJbQliyYMSP8ihkHGoriMLQ_qBDbdWBoM Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Project-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Project-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1020d6403b140d7bd28467afcabf8ae"}]}] Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Tenant: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Tenant-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:19 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-User: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:19 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:08:19 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:08:19 user devstack@n-api.service[61699]: X-User-Id: e6bb5d52609d47e38856a32e3b847bc6 Apr 14 12:08:19 user devstack@n-api.service[61699]: X-User-Name: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:19 user devstack@n-api.service[61699]: method: > Apr 14 12:08:19 user devstack@n-api.service[61699]: exception: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61699]: action_args: {'id': '8f409eb4-2ec5-4481-9cef-5524ec2ae58b'} Apr 14 12:08:19 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Returning 404 to user: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:08:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-19cec561-d0d8-4786-9fee-d26a4d2ea62d tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 404 len: 111 microversion: 2.49 time: 0.044825 Apr 14 12:08:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 194/580] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:08:19 2023] DELETE /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] [instance: 8f409eb4-2ec5-4481-9cef-5524ec2ae58b] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] HTTP exception thrown: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Request method failure captured: Apr 14 12:08:19 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b HTTP/1.1 Apr 14 12:08:19 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:08:19 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:08:19 user devstack@n-api.service[61700]: Connection: close Apr 14 12:08:19 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:08:19 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:08:19 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:08:19 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:08:19 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUE9TfIjUE-gnso72rpLNQY_Ap6i1zF7nt_Bft6MbE2uSMleFcVZ3_9zM_L59jvk87ee4E3qaTIzFQMTjrOLeJYSDRtsHQrqUzkT9WYJK0k3fXUmtXmgKp9Ek_2bUNCdDRPOFSGjA7GR6JuJbQliyYMSP8ihkHGoriMLQ_qBDbdWBoM Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Project-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Project-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1020d6403b140d7bd28467afcabf8ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1020d6403b140d7bd28467afcabf8ae"}]}] Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Tenant: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Tenant-Id: a1020d6403b140d7bd28467afcabf8ae Apr 14 12:08:19 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1431365023 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-User: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:19 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:08:19 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:08:19 user devstack@n-api.service[61700]: X-User-Id: e6bb5d52609d47e38856a32e3b847bc6 Apr 14 12:08:19 user devstack@n-api.service[61700]: X-User-Name: tempest-TaggedAttachmentsTest-1431365023-project-member Apr 14 12:08:19 user devstack@n-api.service[61700]: method: > Apr 14 12:08:19 user devstack@n-api.service[61700]: exception: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61700]: action_args: {'id': '8f409eb4-2ec5-4481-9cef-5524ec2ae58b'} Apr 14 12:08:19 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. Apr 14 12:08:19 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:08:19 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] Returning 404 to user: Instance 8f409eb4-2ec5-4481-9cef-5524ec2ae58b could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:08:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7cb1e645-3dbf-49fe-a265-5d778c0c47d5 tempest-TaggedAttachmentsTest-1431365023 tempest-TaggedAttachmentsTest-1431365023-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b" status: 404 len: 111 microversion: 2.49 time: 0.041512 Apr 14 12:08:19 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 195/581] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:08:19 2023] GET /compute/v2.1/servers/8f409eb4-2ec5-4481-9cef-5524ec2ae58b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:24 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:24 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-7d464c7f-ca59-4dfd-9b44-0ab46ba665c7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 200 len: 1690 microversion: 2.87 time: 0.249861 Apr 14 12:08:24 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 193/582] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:08:24 2023] GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:08:33 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f8f1917c-8b3d-4d28-b3ce-788855b7131f tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f4371ae9ea0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:33 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=20 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:33 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f8f1917c-8b3d-4d28-b3ce-788855b7131f tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/91c6028d-8155-4c4c-bf6f-a1515a6a0a10" status: 200 len: 350 microversion: 2.1 time: 0.051044 Apr 14 12:08:33 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 195/583] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:08:33 2023] GET /compute/v2.1/os-volumes/91c6028d-8155-4c4c-bf6f-a1515a6a0a10 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b72bec32-b57f-47e4-8414-9b049442a69f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.312750 Apr 14 12:08:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 196/584] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:08:36 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments => generated 25 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f6d52a45-aa06-4596-8dbb-a176c3807bfd tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43717ecf70>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f6d52a45-aa06-4596-8dbb-a176c3807bfd tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/54926f12-31ff-48e7-a3dd-115f6c578bae" status: 200 len: 351 microversion: 2.1 time: 0.058028 Apr 14 12:08:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 196/585] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:08:36 2023] GET /compute/v2.1/os-volumes/54926f12-31ff-48e7-a3dd-115f6c578bae => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HTTP exception thrown: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 is not attached to volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Request method failure captured: Apr 14 12:08:36 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments/b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 HTTP/1.1 Apr 14 12:08:36 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:08:36 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:08:36 user devstack@n-api.service[61701]: Connection: close Apr 14 12:08:36 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:08:36 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:08:36 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:08:36 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:08:36 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-pSAkokq8mpEav1B-ziPwZZpdFfVMVB-ZIu1m6U1LHU-EmFjT-x7VDSi4JWxEUntHXcStdkhX71d6Upoy4Ifpo8Z2MyWeVq8QKarDtP-BRPpw8sIIqqAsWABgFKc8OpZBXltons0tSzX1XOIEGWSySGRDuPL4EoCpSFST1BfRcFVM Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Project-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd9936aa363942f6a01bb64a8a8e74c9"}]}] Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Tenant: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Tenant-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:08:36 user devstack@n-api.service[61701]: X-User: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:08:36 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:08:36 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:08:36 user devstack@n-api.service[61701]: X-User-Id: 2eb32a03e7e04da18568294cca0e69bd Apr 14 12:08:36 user devstack@n-api.service[61701]: X-User-Name: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:08:36 user devstack@n-api.service[61701]: method: > Apr 14 12:08:36 user devstack@n-api.service[61701]: exception: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 is not attached to volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 Apr 14 12:08:36 user devstack@n-api.service[61701]: action_args: {'server_id': '075f81e9-8b43-4b05-96be-6eb4cca6d812', 'id': 'b62c6d91-1d0e-42a1-ae0e-68e03d7992d2'} Apr 14 12:08:36 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b62c6d91-1d0e-42a1-ae0e-68e03d7992d2. Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 is not attached to volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 is not attached to volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 Apr 14 12:08:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:08:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Returning 404 to user: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 is not attached to volume b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:08:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-0cf4d4f7-065d-4fbd-ad1e-e6940dabe67d tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments/b62c6d91-1d0e-42a1-ae0e-68e03d7992d2" status: 404 len: 154 microversion: 2.1 time: 0.130289 Apr 14 12:08:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 194/586] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:08:36 2023] DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812/os-volume_attachments/b62c6d91-1d0e-42a1-ae0e-68e03d7992d2 => generated 154 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:08:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3d56eea2-4e89-45a5-b6e3-00a6677a646e tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f437187f6d0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3d56eea2-4e89-45a5-b6e3-00a6677a646e tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2b5806b6-be5b-43e8-a1d1-0d6ee8ad7e8b" status: 200 len: 351 microversion: 2.1 time: 0.060436 Apr 14 12:08:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 197/587] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:08:38 2023] GET /compute/v2.1/os-volumes/2b5806b6-be5b-43e8-a1d1-0d6ee8ad7e8b => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:38 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-77d8536e-1e6b-4086-90ed-344c369cf93f tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43717a3490>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-77d8536e-1e6b-4086-90ed-344c369cf93f tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085525 Apr 14 12:08:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 197/588] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 12:08:38 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-96f606bb-b90c-42b2-9685-858ddb19d1dc tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f4371769000>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-96f606bb-b90c-42b2-9685-858ddb19d1dc tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.112756 Apr 14 12:08:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 195/589] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-189a6f5a-05b7-4083-8f3c-27fc64b4d3f5 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43718fb5b0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-189a6f5a-05b7-4083-8f3c-27fc64b4d3f5 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112996 Apr 14 12:08:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 198/590] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-587c1a5e-b224-4d4f-838e-a01bc14db334 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43717ec1f0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-587c1a5e-b224-4d4f-838e-a01bc14db334 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083948 Apr 14 12:08:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 198/591] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d2c32bc8-0590-403d-a413-134a1c593d99 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f437176acb0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d2c32bc8-0590-403d-a413-134a1c593d99 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100003 Apr 14 12:08:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 196/592] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-22ef3e30-dfbd-46c0-b6bd-996dd31b3f66 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f4371b57010>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-22ef3e30-dfbd-46c0-b6bd-996dd31b3f66 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086075 Apr 14 12:08:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 199/593] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-14d1b985-be69-4152-afd2-7eb24d348523 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43717a3010>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-14d1b985-be69-4152-afd2-7eb24d348523 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082252 Apr 14 12:08:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 199/594] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-88a48249-225e-4064-89ed-4e108bfb1544 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] Calling method '.version_select at 0x7f43716989d0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:08:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-88a48249-225e-4064-89ed-4e108bfb1544 tempest-VolumesTestJSON-1530226297 tempest-VolumesTestJSON-1530226297-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.170645 Apr 14 12:08:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 197/595] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-10266b6b-755a-4cd6-9196-ec36663e11a0 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 204 len: 0 microversion: 2.1 time: 0.151134 Apr 14 12:08:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 200/596] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:08:39 2023] DELETE /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:40 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb32a03e7e04da18568294cca0e69bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9936aa363942f6a01bb64a8a8e74c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9ba4a6b2-abcd-4a3d-baa4-ad3f3a9c6c52 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 200 len: 1543 microversion: 2.1 time: 0.235211 Apr 14 12:08:40 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:08:39 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 1543 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:08:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-unplugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] Creating event network-vif-unplugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:08:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-26399041-d970-44a6-b72c-83c644575780 req-4c1ee965-11e6-4a9e-9622-05a4584019aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034000 Apr 14 12:08:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 198/598] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-plugged", "status": "completed", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}, {"server_uuid": "075f81e9-8b43-4b05-96be-6eb4cca6d812", "name": "network-vif-deleted", "tag": "a8047706-f64e-47f2-bb99-b1e66dbd2df8"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:08:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Creating event network-vif-plugged:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:08:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] Creating event network-vif-deleted:a8047706-f64e-47f2-bb99-b1e66dbd2df8 for instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 on user Apr 14 12:08:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-31defb06-5032-441c-b28f-357216f7e7b7 req-885ebd6c-bd81-4ec6-8512-65ef479c5635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029773 Apr 14 12:08:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 201/599] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:59 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:08:59 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-186d138e-9319-4896-ae79-f5398330d8a5 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1704 microversion: 2.20 time: 0.148866 Apr 14 12:08:59 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 201/600] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:08:59 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1704 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=8 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:08:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:08:59 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ed9c3f79-bcf7-478d-bad3-146729648b26 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094175 Apr 14 12:08:59 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 199/601] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:08:59 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b2e92e64-927b-4462-96a7-e75b656e047f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1676 microversion: 2.1 time: 0.171079 Apr 14 12:09:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 202/602] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:00 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c780c46e-dc6e-4f00-beba-ff92583ecfdb tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1676 microversion: 2.1 time: 0.153944 Apr 14 12:09:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 202/603] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:00 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9804be1d-2be1-4e77-a2ee-e7c175209bfe tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1676 microversion: 2.1 time: 0.162806 Apr 14 12:09:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:00 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] [instance: bf72b2ec-5763-47e9-b9a8-b0cf9df9d649] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] HTTP exception thrown: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Request method failure captured: Apr 14 12:09:00 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 HTTP/1.1 Apr 14 12:09:00 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:09:00 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:09:00 user devstack@n-api.service[61700]: Connection: close Apr 14 12:09:00 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:09:00 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:09:00 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:09:00 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:09:00 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUDPmx2Fn0Lmxw8i6UnL4fc0SFg-hJlG0YE5fc6du3HjXkPIJx1fIDTEjhsVYCxHmMu0-vYRJEXfy_iDTemceyIBAZo90veIerCboYGbmw8M3O0rZUaQhXc3eqOAIGY5LpZ_eZg4lIE9JMpsxKLXdJh_gYUXHgyo79fSTEK4H8W24xk Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Project-Id: ae5ac6388692423b9bf23bf6be0cb06d Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5ac6388692423b9bf23bf6be0cb06d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ae5ac6388692423b9bf23bf6be0cb06d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ae5ac6388692423b9bf23bf6be0cb06d"}]}] Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Tenant-Id: ae5ac6388692423b9bf23bf6be0cb06d Apr 14 12:09:00 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1634639087 Apr 14 12:09:00 user devstack@n-api.service[61700]: X-User: tempest-VolumesSnapshotTestJSON-1634639087-project-member Apr 14 12:09:00 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:09:00 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:09:00 user devstack@n-api.service[61700]: X-User-Id: 61adadbd79ef493889ef3dcb63f63fd8 Apr 14 12:09:00 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesSnapshotTestJSON-1634639087-project-member Apr 14 12:09:00 user devstack@n-api.service[61700]: method: > Apr 14 12:09:00 user devstack@n-api.service[61700]: exception: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. Apr 14 12:09:00 user devstack@n-api.service[61700]: action_args: {'id': 'bf72b2ec-5763-47e9-b9a8-b0cf9df9d649'} Apr 14 12:09:00 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. Apr 14 12:09:00 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:09:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] Returning 404 to user: Instance bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:09:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0e774bad-5991-44bf-87fc-ce1286c69d37 tempest-VolumesSnapshotTestJSON-1634639087 tempest-VolumesSnapshotTestJSON-1634639087-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649" status: 404 len: 111 microversion: 2.1 time: 0.027306 Apr 14 12:09:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 203/605] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:00 2023] GET /compute/v2.1/servers/bf72b2ec-5763-47e9-b9a8-b0cf9df9d649 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: b79d8978-9bc5-4a22-98cf-025f949dc1bc] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] HTTP exception thrown: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Request method failure captured: Apr 14 12:09:06 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc HTTP/1.1 Apr 14 12:09:06 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:09:06 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:09:06 user devstack@n-api.service[61699]: Connection: close Apr 14 12:09:06 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:09:06 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:09:06 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:09:06 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:09:06 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUC9wZzJwahSOsFMf_5NLQpuWnznxP_VySm8vf61cE1i6RxOrPJhwsOcld2z6yVOOikAIUBAOt4ifnKXt5x1D3LoYLSlpNEPVmQO07-aSrj9tW5uJ4y7McTEZogiRSdaX1Q2LtK-dcHtiVcBo8OcSOwT4BE-KrTzRBtKLhbVKuIdZ90 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Project-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestStampPattern-1032317746 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfb2ac7942e1473f88b05de5aa79a3ee"}]}] Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Tenant: tempest-TestStampPattern-1032317746 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Tenant-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:09:06 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestStampPattern-1032317746 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-User: tempest-TestStampPattern-1032317746-project-member Apr 14 12:09:06 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:09:06 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:09:06 user devstack@n-api.service[61699]: X-User-Id: e2b8b516910f41ffbb8bbf5f9e3c2ec8 Apr 14 12:09:06 user devstack@n-api.service[61699]: X-User-Name: tempest-TestStampPattern-1032317746-project-member Apr 14 12:09:06 user devstack@n-api.service[61699]: method: > Apr 14 12:09:06 user devstack@n-api.service[61699]: exception: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. Apr 14 12:09:06 user devstack@n-api.service[61699]: action_args: {'id': 'b79d8978-9bc5-4a22-98cf-025f949dc1bc'} Apr 14 12:09:06 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. Apr 14 12:09:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Returning 404 to user: Instance b79d8978-9bc5-4a22-98cf-025f949dc1bc could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:09:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7fa87c94-c869-4f95-b4b1-361701486e53 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc" status: 404 len: 111 microversion: 2.1 time: 0.033139 Apr 14 12:09:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 203/606] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:06 2023] GET /compute/v2.1/servers/b79d8978-9bc5-4a22-98cf-025f949dc1bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=12 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] HTTP exception thrown: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac is not attached to volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Request method failure captured: Apr 14 12:09:13 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments/26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 HTTP/1.1 Apr 14 12:09:13 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:09:13 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:09:13 user devstack@n-api.service[61701]: Connection: close Apr 14 12:09:13 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:09:13 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:09:13 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:09:13 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:09:13 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUC9wZzJwahSOsFMf_5NLQpuWnznxP_VySm8vf61cE1i6RxOrPJhwsOcld2z6yVOOikAIUBAOt4ifnKXt5x1D3LoYLSlpNEPVmQO07-aSrj9tW5uJ4y7McTEZogiRSdaX1Q2LtK-dcHtiVcBo8OcSOwT4BE-KrTzRBtKLhbVKuIdZ90 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Project-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestStampPattern-1032317746 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfb2ac7942e1473f88b05de5aa79a3ee"}]}] Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Tenant: tempest-TestStampPattern-1032317746 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Tenant-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:09:13 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestStampPattern-1032317746 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-User: tempest-TestStampPattern-1032317746-project-member Apr 14 12:09:13 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:09:13 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:09:13 user devstack@n-api.service[61701]: X-User-Id: e2b8b516910f41ffbb8bbf5f9e3c2ec8 Apr 14 12:09:13 user devstack@n-api.service[61701]: X-User-Name: tempest-TestStampPattern-1032317746-project-member Apr 14 12:09:13 user devstack@n-api.service[61701]: method: > Apr 14 12:09:13 user devstack@n-api.service[61701]: exception: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac is not attached to volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 Apr 14 12:09:13 user devstack@n-api.service[61701]: action_args: {'server_id': 'ba2689ad-6a47-45c2-b5db-bec9e5a152ac', 'id': '26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9'} Apr 14 12:09:13 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9. Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac is not attached to volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac is not attached to volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 Apr 14 12:09:13 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Returning 404 to user: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac is not attached to volume 26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:09:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b2b41b1a-42ed-4ed0-add3-6fb4cce74d20 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments/26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9" status: 404 len: 154 microversion: 2.1 time: 0.109761 Apr 14 12:09:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 201/607] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:09:13 2023] DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac/os-volume_attachments/26937ca9-b3ef-48ae-a2f9-ffc0ea9a13c9 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] Creating event network-changed:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-9c56904c-250f-43b8-80de-d6f81a618304 req-35cd1c0d-d832-4afa-9ecb-d242f686a443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030221 Apr 14 12:09:13 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 204/608] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:13 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:09:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-54e7d021-af6d-4aba-9299-b4773d1099ef tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 204 len: 0 microversion: 2.1 time: 0.138251 Apr 14 12:09:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 204/609] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:09:13 2023] DELETE /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-unplugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] Creating event network-vif-unplugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2d9cd554-a209-478a-8d8e-53c111ae5eb0 req-89399ba4-8042-41ec-8e7a-2922b5c9b4e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047698 Apr 14 12:09:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 205/610] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:14 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b8b516910f41ffbb8bbf5f9e3c2ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb2ac7942e1473f88b05de5aa79a3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1485591a-f9ec-4437-bcdc-937ef7ef11a7 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 200 len: 1661 microversion: 2.1 time: 0.328845 Apr 14 12:09:14 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 202/611] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:14 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 1661 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-deleted", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] Creating event network-vif-deleted:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-31d2f954-2a41-4902-9f2a-6febb62a6058 req-8924faf3-dd7e-45fd-bc88-6616adb2ab7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Apr 14 12:09:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 205/612] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}, {"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}, {"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}, {"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-unplugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}, {"server_uuid": "ba2689ad-6a47-45c2-b5db-bec9e5a152ac", "name": "network-vif-plugged", "status": "completed", "tag": "fd5df68e-d97d-41be-a98a-d5d7b77a0044"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Creating event network-vif-unplugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] Creating event network-vif-plugged:fd5df68e-d97d-41be-a98a-d5d7b77a0044 for instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac on user Apr 14 12:09:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-998446ba-2088-4651-b1da-f85df8b65ceb req-c28a278c-1248-4e73-9c9b-6c8a3b085b46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034551 Apr 14 12:09:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 206/613] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 while it is in vm_state rescued Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Request method failure captured: Apr 14 12:09:16 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments/456eefe5-dfcc-43aa-bb82-87ee292ece79 HTTP/1.1 Apr 14 12:09:16 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:09:16 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:09:16 user devstack@n-api.service[61701]: Connection: close Apr 14 12:09:16 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:09:16 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:09:16 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:09:16 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:09:16 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-C9tpHsLruDVTR0wMVP0JRY5wOhKQtycKsYhc-XXk2kYrqcy8r1SONI4mGY7erU46n2nC8PTNnUHogLYf2cSRjef0D9q6JPq1zx-OFsDvX-9rBy0ZayzoXcJuJWuipRYIXF1iz5-PJpHxg_HJGuoaSq17PLUZjtQt7FxBoM6mLbFo Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Project-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f042abdcef8f41488e8f4624c2f4970b"}]}] Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Tenant-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:09:16 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:09:16 user devstack@n-api.service[61701]: X-User: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:09:16 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:09:16 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:09:16 user devstack@n-api.service[61701]: X-User-Id: 263c47076ee94cfaaa34eff928a36fdd Apr 14 12:09:16 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:09:16 user devstack@n-api.service[61701]: method: > Apr 14 12:09:16 user devstack@n-api.service[61701]: exception: Cannot 'detach_volume' instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 while it is in vm_state rescued Apr 14 12:09:16 user devstack@n-api.service[61701]: action_args: {'server_id': '4595c0e6-f2af-47ef-b26e-7b1ccb58aa47', 'id': '456eefe5-dfcc-43aa-bb82-87ee292ece79'} Apr 14 12:09:16 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 while it is in vm_state rescued Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 while it is in vm_state rescued Apr 14 12:09:16 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:09:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Returning 409 to user: Cannot 'detach_volume' instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 while it is in vm_state rescued {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:09:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1dadb13f-1aaf-4a30-8644-7e9880d5245e tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments/456eefe5-dfcc-43aa-bb82-87ee292ece79" status: 409 len: 152 microversion: 2.1 time: 0.116379 Apr 14 12:09:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 203/614] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:09:16 2023] DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments/456eefe5-dfcc-43aa-bb82-87ee292ece79 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0605c743-c8c7-4773-820c-f41f09fb3263 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/action" status: 202 len: 0 microversion: 2.1 time: 0.076991 Apr 14 12:09:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 206/615] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:09:16 2023] POST /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:17 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-305c5934-4eb9-44f9-b70d-f2808e6031d3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1713 microversion: 2.1 time: 0.159934 Apr 14 12:09:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 207/616] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:16 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}, {"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-06ba5731-a5a4-4d8c-83bb-20c8b9cb43b5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 200 len: 1377 microversion: 2.1 time: 0.164344 Apr 14 12:09:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 204/617] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:18 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 1377 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Creating event network-vif-unplugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:09:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:09:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-fb1eb08e-f92b-437d-87a0-8957b3067eb7 req-338b5ca5-75f1-4b38-9486-dd73fb2f55fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032339 Apr 14 12:09:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 207/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-72f1a7fe-e2a6-436d-8a08-313c7d877c08 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 200 len: 1377 microversion: 2.1 time: 0.158185 Apr 14 12:09:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 208/619] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:18 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 1377 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:09:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-cef88d5a-4816-4c5c-8ff3-ff6a08aaf3de tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 204 len: 0 microversion: 2.1 time: 0.144874 Apr 14 12:09:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 205/620] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:09:18 2023] DELETE /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:19 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:19 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a843f896-9f9f-45dc-ab14-ed89f9d809d3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 200 len: 1383 microversion: 2.1 time: 0.250413 Apr 14 12:09:19 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 208/621] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:18 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 1383 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "name": "network-vif-unplugged", "status": "completed", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}, {"server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "name": "network-vif-plugged", "status": "completed", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}, {"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Creating event network-vif-unplugged:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:09:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Creating event network-vif-plugged:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:09:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:09:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-733e9db8-a1b0-4096-b357-26af6175a817 req-65659294-0cbc-4590-85e7-1bee088f8977 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035411 Apr 14 12:09:20 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 209/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:21 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da5f24e-8cf1-4318-a4f4-e53c16756510", "name": "network-vif-deleted", "tag": "a634601e-0b2d-48e8-8777-f6ceec473beb"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] Creating event network-vif-deleted:a634601e-0b2d-48e8-8777-f6ceec473beb for instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 on user Apr 14 12:09:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-3f404c0b-ffbb-400b-89e2-e9b82ae24c69 req-89b43aaf-9ee8-4985-8591-96b04bf1cacc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069184 Apr 14 12:09:21 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 206/623] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:09:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-3992b7f3-c5f9-4eb7-ac37-a2d3496ab072 req-88a8cdf6-5a14-4a52-ab72-8fff547e4792 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053055 Apr 14 12:09:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 209/624] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1172257873", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "destination_type": "volume"}], "networks": [{"uuid": "609095b3-aa7f-45b1-a300-792fe3c6435a"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:24 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] validate_networks() for [('609095b3-aa7f-45b1-a300-792fe3c6435a', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Getting quotas for user 11df88c60e4b456691d8731fe8facf38 and project 2c5140d4419e43be941c2ac5d5439e35. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:09:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:09:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-94e3c8fc-51cc-4c2c-9d4a-697d0eddfc85 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.154113 Apr 14 12:09:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 210/625] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 12:09:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 12:09:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:25 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:25 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:25 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-372bfe9d-e2c9-43a1-90ff-7967eff2dbf3 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1395 microversion: 2.87 time: 0.079530 Apr 14 12:09:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 207/626] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:09:25 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:09:28 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:28 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] Creating event network-changed:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:09:28 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-3d7c168a-b8e2-45ae-9410-ea55191a05ac req-7272b2cf-c0ba-4b7c-8b5a-84e64b20d89f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034825 Apr 14 12:09:28 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 210/627] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] [instance: 075f81e9-8b43-4b05-96be-6eb4cca6d812] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=37 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] HTTP exception thrown: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Request method failure captured: Apr 14 12:09:30 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 HTTP/1.1 Apr 14 12:09:30 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:09:30 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:09:30 user devstack@n-api.service[61699]: Connection: close Apr 14 12:09:30 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:09:30 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:09:30 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:09:30 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:09:30 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-pSAkokq8mpEav1B-ziPwZZpdFfVMVB-ZIu1m6U1LHU-EmFjT-x7VDSi4JWxEUntHXcStdkhX71d6Upoy4Ifpo8Z2MyWeVq8QKarDtP-BRPpw8sIIqqAsWABgFKc8OpZBXltons0tSzX1XOIEGWSySGRDuPL4EoCpSFST1BfRcFVM Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Project-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd9936aa363942f6a01bb64a8a8e74c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd9936aa363942f6a01bb64a8a8e74c9"}]}] Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Tenant: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Tenant-Id: cd9936aa363942f6a01bb64a8a8e74c9 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-881161311 Apr 14 12:09:30 user devstack@n-api.service[61699]: X-User: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:09:30 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:09:30 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:09:30 user devstack@n-api.service[61699]: X-User-Id: 2eb32a03e7e04da18568294cca0e69bd Apr 14 12:09:30 user devstack@n-api.service[61699]: X-User-Name: tempest-TestMinimumBasicScenario-881161311-project-member Apr 14 12:09:30 user devstack@n-api.service[61699]: method: > Apr 14 12:09:30 user devstack@n-api.service[61699]: exception: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. Apr 14 12:09:30 user devstack@n-api.service[61699]: action_args: {'id': '075f81e9-8b43-4b05-96be-6eb4cca6d812'} Apr 14 12:09:30 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. Apr 14 12:09:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:09:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Returning 404 to user: Instance 075f81e9-8b43-4b05-96be-6eb4cca6d812 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:09:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-def0db3e-e757-4337-ac33-749f02cdc010 tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812" status: 404 len: 111 microversion: 2.1 time: 0.041123 Apr 14 12:09:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 211/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:30 2023] GET /compute/v2.1/servers/075f81e9-8b43-4b05-96be-6eb4cca6d812 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:09:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e27fd060-d8e0-4b13-b29f-406a4b7fe29f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] Calling method '.version_select at 0x7f43716e60e0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e27fd060-d8e0-4b13-b29f-406a4b7fe29f tempest-TestMinimumBasicScenario-881161311 tempest-TestMinimumBasicScenario-881161311-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1755081879" status: 202 len: 0 microversion: 2.1 time: 0.037142 Apr 14 12:09:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 208/629] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 12:09:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1755081879 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:41 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:09:41 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-781fc379-e1bc-47c3-b5df-2e592fbfb6e0 req-eed2344f-7f11-4685-b437-693931a4100d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Apr 14 12:09:41 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 211/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:09:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-3ad5b718-84b8-441c-9a80-30695d7484de req-5e6747e1-5565-4257-899e-aefd36ff1242 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050950 Apr 14 12:09:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 212/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:09:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-df93c1a8-b94b-4852-a100-cea8f434ca49 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: .version_select at 0x7f43716e4820>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1808636935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeK2kkEDkG9iLiMYwLTjGqJrptZva+1c0p4rLwp6Kk8Ay66sIEsFK5byYYvBJZAtQ3XJxpD1thW71w6SHAc/DlHS3qz+eCj4QMPuTIrIFeoZQnSEs/TE6quNmIDzUDixQ=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-df93c1a8-b94b-4852-a100-cea8f434ca49 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting quotas for project 4f89371d6c614961849733631ca6be66. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:09:55 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-df93c1a8-b94b-4852-a100-cea8f434ca49 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting quotas for user f4e6f51853194dd7931111ff84ea10fb and project 4f89371d6c614961849733631ca6be66. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:09:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-df93c1a8-b94b-4852-a100-cea8f434ca49 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.348170 Apr 14 12:09:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 209/632] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:09:55 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:09:57 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:57 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-665226386", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1808636935", "security_groups": [{"name": "tempest-secgroup-smoke-171154308"}], "networks": [{"uuid": "c440d25d-1de9-42ef-b8fd-bb92d9a2a30d"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:09:57 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] validate_networks() for [('c440d25d-1de9-42ef-b8fd-bb92d9a2a30d', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting quotas for project 4f89371d6c614961849733631ca6be66. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Getting quotas for user f4e6f51853194dd7931111ff84ea10fb and project 4f89371d6c614961849733631ca6be66. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:09:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:09:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7ae96a86-556a-471d-b431-93b61897e243 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.048266 Apr 14 12:09:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 212/633] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:09:57 2023] POST /compute/v2.1/servers => generated 403 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:09:58 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:58 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:09:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-717c319b-7249-4c01-b85e-81b61f302009 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:58 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-717c319b-7249-4c01-b85e-81b61f302009 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:58 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-717c319b-7249-4c01-b85e-81b61f302009 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6f51853194dd7931111ff84ea10fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f89371d6c614961849733631ca6be66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:09:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-717c319b-7249-4c01-b85e-81b61f302009 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 200 len: 1256 microversion: 2.1 time: 0.098419 Apr 14 12:09:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 213/634] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:09:58 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 1256 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:59 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c1136d68-b0a2-488b-b29e-721d39c7ee7b tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052178 Apr 14 12:09:59 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 210/635] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 12:09:59 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:59 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:09:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-15477868-a859-4e12-82e3-1b6e7201f05f tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 204 len: 0 microversion: 2.20 time: 0.174248 Apr 14 12:09:59 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 213/636] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:09:59 2023] DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:09:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:00 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:00 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:00 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '260d1d4ef5a1422f84f9d91224b53952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc13fb093d2745e8ba0152533140b6f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-72abffcf-3f15-4964-8a4f-21506ff90fe4 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 200 len: 1710 microversion: 2.20 time: 0.341784 Apr 14 12:10:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 214/637] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:09:59 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 1710 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:10:00 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-unplugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:00 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] Creating event network-vif-unplugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:10:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-3bd21ec2-709f-41d5-8af0-d3cb5d1d5516 req-52571141-ec77-48dd-9b59-cf7c2dea231d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039032 Apr 14 12:10:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 211/638] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:02 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-plugged", "status": "completed", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] Creating event network-vif-plugged:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:10:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-4ce9defe-0ca4-4a9d-b390-e54c45fb2b99 req-9d1be475-824b-41ba-982c-2ab7d8641ccb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Apr 14 12:10:02 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:03 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:03 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-df851a63-668d-4a85-9156-faf2809d67ba tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1676 microversion: 2.1 time: 0.159727 Apr 14 12:10:03 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 215/640] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:03 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42f9d56-b181-465a-9ed8-ef4b1f47832b"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1622a7a3-76b3-4460-be0f-ea847e8a3459 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285288 Apr 14 12:10:03 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 212/641] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:10:03 2023] POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] [instance: ba2689ad-6a47-45c2-b5db-bec9e5a152ac] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] HTTP exception thrown: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Request method failure captured: Apr 14 12:10:04 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac HTTP/1.1 Apr 14 12:10:04 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:10:04 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:10:04 user devstack@n-api.service[61700]: Connection: close Apr 14 12:10:04 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:10:04 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:10:04 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:10:04 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:10:04 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUC9wZzJwahSOsFMf_5NLQpuWnznxP_VySm8vf61cE1i6RxOrPJhwsOcld2z6yVOOikAIUBAOt4ifnKXt5x1D3LoYLSlpNEPVmQO07-aSrj9tW5uJ4y7McTEZogiRSdaX1Q2LtK-dcHtiVcBo8OcSOwT4BE-KrTzRBtKLhbVKuIdZ90 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Project-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestStampPattern-1032317746 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfb2ac7942e1473f88b05de5aa79a3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfb2ac7942e1473f88b05de5aa79a3ee"}]}] Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Tenant: tempest-TestStampPattern-1032317746 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Tenant-Id: cfb2ac7942e1473f88b05de5aa79a3ee Apr 14 12:10:04 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestStampPattern-1032317746 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-User: tempest-TestStampPattern-1032317746-project-member Apr 14 12:10:04 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:10:04 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:10:04 user devstack@n-api.service[61700]: X-User-Id: e2b8b516910f41ffbb8bbf5f9e3c2ec8 Apr 14 12:10:04 user devstack@n-api.service[61700]: X-User-Name: tempest-TestStampPattern-1032317746-project-member Apr 14 12:10:04 user devstack@n-api.service[61700]: method: > Apr 14 12:10:04 user devstack@n-api.service[61700]: exception: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. Apr 14 12:10:04 user devstack@n-api.service[61700]: action_args: {'id': 'ba2689ad-6a47-45c2-b5db-bec9e5a152ac'} Apr 14 12:10:04 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. Apr 14 12:10:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Returning 404 to user: Instance ba2689ad-6a47-45c2-b5db-bec9e5a152ac could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-232c4544-7686-4e52-a4c4-c2a958b0c395 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac" status: 404 len: 111 microversion: 2.1 time: 0.036302 Apr 14 12:10:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 215/642] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:04 2023] GET /compute/v2.1/servers/ba2689ad-6a47-45c2-b5db-bec9e5a152ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:10:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5181aed1-2933-4b33-893e-eb30a0d4ff4c", "name": "network-vif-deleted", "tag": "923fca3f-14a0-481e-8c0c-6cb7cc7a04bb"}, {"name": "network-changed", "server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Creating event network-vif-deleted:923fca3f-14a0-481e-8c0c-6cb7cc7a04bb for instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c on user Apr 14 12:10:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] Creating event network-changed:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:10:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ff954f1e-4c70-4f65-9ec7-814a0a79305b req-35d1c8e1-0edc-4d3d-97ca-cfd4631969e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039987 Apr 14 12:10:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 216/643] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:05 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:05 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "name": "network-vif-plugged", "status": "completed", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:05 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] Creating event network-vif-plugged:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:10:05 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-44dc55ea-e373-4302-855e-49beda35f485 req-969623e6-bee0-473c-9f32-3e8a4f57fa93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Apr 14 12:10:05 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 213/644] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7c772c27-f955-4ee4-910a-70c19a7720a1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1719 microversion: 2.1 time: 0.167353 Apr 14 12:10:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 216/645] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:07 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:10:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "name": "network-vif-plugged", "status": "completed", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] Creating event network-vif-plugged:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:10:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8a88add6-0128-4f0e-af58-df994e206bda req-6324a5a0-bf9b-4368-bfdd-48a7097f2867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051596 Apr 14 12:10:07 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 217/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e9f60dd8-2070-49fe-bd98-a8000967d987 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] Calling method '.version_select at 0x7f43716e75b0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e9f60dd8-2070-49fe-bd98-a8000967d987 tempest-TestStampPattern-1032317746 tempest-TestStampPattern-1032317746-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1794429979" status: 202 len: 0 microversion: 2.1 time: 0.030509 Apr 14 12:10:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 214/647] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:10:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1794429979 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:10:09 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 HTTP/1.1 Apr 14 12:10:09 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:10:09 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:10:09 user devstack@n-api.service[61700]: Connection: close Apr 14 12:10:09 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:10:09 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:10:09 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:10:09 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:10:09 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61700]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61700]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:10:09 user devstack@n-api.service[61700]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61700]: method: > Apr 14 12:10:09 user devstack@n-api.service[61700]: exception: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61700]: action_args: {'id': '0da5f24e-8cf1-4318-a4f4-e53c16756510'} Apr 14 12:10:09 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ae2ce764-63a9-475d-b3be-c650ea522c30 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 404 len: 111 microversion: 2.1 time: 0.049436 Apr 14 12:10:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 217/648] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:09 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:10:09 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 HTTP/1.1 Apr 14 12:10:09 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:10:09 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:10:09 user devstack@n-api.service[61699]: Connection: close Apr 14 12:10:09 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:10:09 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:10:09 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:10:09 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:10:09 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:10:09 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61699]: method: > Apr 14 12:10:09 user devstack@n-api.service[61699]: exception: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61699]: action_args: {'id': '0da5f24e-8cf1-4318-a4f4-e53c16756510'} Apr 14 12:10:09 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-47b7dc0b-9de1-4753-80e4-e2d64c90b54c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 404 len: 111 microversion: 2.1 time: 0.043900 Apr 14 12:10:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 218/649] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:10:09 2023] DELETE /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 0da5f24e-8cf1-4318-a4f4-e53c16756510] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:10:09 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 HTTP/1.1 Apr 14 12:10:09 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:10:09 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:10:09 user devstack@n-api.service[61701]: Connection: close Apr 14 12:10:09 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:10:09 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:10:09 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:10:09 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:10:09 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:10:09 user devstack@n-api.service[61701]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:10:09 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:10:09 user devstack@n-api.service[61701]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:10:09 user devstack@n-api.service[61701]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:10:09 user devstack@n-api.service[61701]: method: > Apr 14 12:10:09 user devstack@n-api.service[61701]: exception: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61701]: action_args: {'id': '0da5f24e-8cf1-4318-a4f4-e53c16756510'} Apr 14 12:10:09 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. Apr 14 12:10:09 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 0da5f24e-8cf1-4318-a4f4-e53c16756510 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ff80788d-8465-48e1-abd0-d7b77f80f383 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510" status: 404 len: 111 microversion: 2.1 time: 0.056776 Apr 14 12:10:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 215/650] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:09 2023] GET /compute/v2.1/servers/0da5f24e-8cf1-4318-a4f4-e53c16756510 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Old instance type m1.nano, new instance type m1.micro {{(pid=61700) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:10:11 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:10:11 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b6fbbae6-2435-46bb-bfde-4d6189e93e7b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action" status: 202 len: 0 microversion: 2.1 time: 0.502629 Apr 14 12:10:11 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 218/651] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:10:11 2023] POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:11 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:11 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-81bfd82b-31fe-4ccb-9794-2f477b5cce6f tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1731 microversion: 2.1 time: 0.270010 Apr 14 12:10:11 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 219/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:11 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:10:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:10:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:10:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-bd8f4ff7-1a4b-4238-8640-12d2057a9aa7 req-c1e252a5-7f13-4b14-a726-3d82b7f27add service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061861 Apr 14 12:10:15 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 216/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5ac1459d-3fb8-4b1f-a616-7d8251bc8aa1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1769 microversion: 2.87 time: 0.182801 Apr 14 12:10:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 219/654] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:10:15 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1769 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:10:17 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:10:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:10:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ea417cb2-7eb1-4d7a-b090-cd869e2e3375 req-8d04ab15-75d5-4050-8815-b37ae6aa52ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049947 Apr 14 12:10:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 220/655] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2088634438", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "c08cb094-2346-4a3a-9cd4-758810dd7f07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:20 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:10:21 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c08cb094-2346-4a3a-9cd4-758810dd7f07',volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:10:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-3522c323-254d-4f81-9789-7f5d0147c332 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.992524 Apr 14 12:10:21 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 217/656] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:10:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:10:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-115b62cc-2327-4174-8654-569a4c71abcd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:21 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-115b62cc-2327-4174-8654-569a4c71abcd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:21 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:21 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-115b62cc-2327-4174-8654-569a4c71abcd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-115b62cc-2327-4174-8654-569a4c71abcd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 200 len: 1066 microversion: 2.1 time: 0.088152 Apr 14 12:10:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 220/657] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:21 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 1066 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:10:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] Creating event network-changed:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:10:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f7ab1809-d670-463d-b832-f34ad69ce2a5 req-0c3f9b06-dbd9-4ece-a3c8-ea88f89170d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037392 Apr 14 12:10:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 221/658] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:10:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:10:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-231221e7-5aec-41a5-978f-22cc692a76b3 req-effd2986-67a3-4286-8f42-de27380509a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051382 Apr 14 12:10:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 218/659] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:10:32 user devstack@n-api.service[61700]: DEBUG nova.compute.api [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:10:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ab8d07b6-bb01-45e8-9287-05cda9867f90 req-f15cc3b6-5ba6-4ac5-ab95-8cd6bbffb20b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105978 Apr 14 12:10:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 221/660] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "name": "network-vif-plugged", "status": "completed", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=21 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:34 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=31 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:34 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] Creating event network-vif-plugged:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:10:34 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-a33dcb96-aa8c-4815-8d32-685150108473 req-60143d02-9ac3-4dd8-943b-b12de4810f06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082892 Apr 14 12:10:34 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 222/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "name": "network-vif-plugged", "status": "completed", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] Creating event network-vif-plugged:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:10:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-bc6161b5-1761-4a4a-93c2-52004c560c91 req-be50ad9d-3e59-47a2-99c3-3fd776d26c7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106569 Apr 14 12:10:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 219/662] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:48 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6f51853194dd7931111ff84ea10fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f89371d6c614961849733631ca6be66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:10:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-cfaa032a-f8ae-498f-8dc0-0afc72c7f83a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 200 len: 1567 microversion: 2.1 time: 0.159391 Apr 14 12:10:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 222/663] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:10:48 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:10:50 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c HTTP/1.1 Apr 14 12:10:50 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:10:50 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:10:50 user devstack@n-api.service[61699]: Connection: close Apr 14 12:10:50 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:10:50 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:10:50 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:10:50 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:10:50 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:50 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:10:50 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:10:50 user devstack@n-api.service[61699]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:10:50 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:50 user devstack@n-api.service[61699]: method: > Apr 14 12:10:50 user devstack@n-api.service[61699]: exception: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:50 user devstack@n-api.service[61699]: action_args: {'id': '5181aed1-2933-4b33-893e-eb30a0d4ff4c'} Apr 14 12:10:50 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:50 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-fe2dbbff-4384-4c2f-9360-e162337a26f2 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 404 len: 111 microversion: 2.20 time: 0.047748 Apr 14 12:10:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 223/664] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:10:50 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:10:50 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:50 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=5 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:10:50 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8f5d1e50-464b-42eb-a2fd-be551deb3ec8 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '.version_select at 0x7f43716e6e60>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8f5d1e50-464b-42eb-a2fd-be551deb3ec8 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230816513" status: 204 len: 0 microversion: 2.20 time: 0.029343 Apr 14 12:10:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 220/665] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 12:10:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230816513 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:10:54 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c HTTP/1.1 Apr 14 12:10:54 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:10:54 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:10:54 user devstack@n-api.service[61700]: Connection: close Apr 14 12:10:54 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:10:54 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:10:54 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:10:54 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:10:54 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:54 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:10:54 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:10:54 user devstack@n-api.service[61700]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:10:54 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:54 user devstack@n-api.service[61700]: method: > Apr 14 12:10:54 user devstack@n-api.service[61700]: exception: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61700]: action_args: {'id': '5181aed1-2933-4b33-893e-eb30a0d4ff4c'} Apr 14 12:10:54 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5ff271ae-8c8e-4aef-8444-c3f4e9ad0b21 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 404 len: 111 microversion: 2.20 time: 0.039886 Apr 14 12:10:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 223/666] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:10:54 2023] DELETE /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: 5181aed1-2933-4b33-893e-eb30a0d4ff4c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:10:54 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c HTTP/1.1 Apr 14 12:10:54 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:10:54 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:10:54 user devstack@n-api.service[61699]: Connection: close Apr 14 12:10:54 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:10:54 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:10:54 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:10:54 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:10:54 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:54 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:10:54 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:10:54 user devstack@n-api.service[61699]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:10:54 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:54 user devstack@n-api.service[61699]: method: > Apr 14 12:10:54 user devstack@n-api.service[61699]: exception: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61699]: action_args: {'id': '5181aed1-2933-4b33-893e-eb30a0d4ff4c'} Apr 14 12:10:54 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. Apr 14 12:10:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:10:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance 5181aed1-2933-4b33-893e-eb30a0d4ff4c could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-629db223-6a71-43d9-87b0-4d826bf8bff7 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c" status: 404 len: 111 microversion: 2.20 time: 0.031617 Apr 14 12:10:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 224/667] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:10:54 2023] GET /compute/v2.1/servers/5181aed1-2933-4b33-893e-eb30a0d4ff4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:10:58 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 HTTP/1.1 Apr 14 12:10:58 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:10:58 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:10:58 user devstack@n-api.service[61701]: Connection: close Apr 14 12:10:58 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:10:58 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:10:58 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:10:58 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:10:58 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:58 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:10:58 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:10:58 user devstack@n-api.service[61701]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:10:58 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:58 user devstack@n-api.service[61701]: method: > Apr 14 12:10:58 user devstack@n-api.service[61701]: exception: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61701]: action_args: {'id': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4'} Apr 14 12:10:58 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6f445be4-0ad0-45bc-bbec-2f4b45821428 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 404 len: 111 microversion: 2.20 time: 0.040741 Apr 14 12:10:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 221/668] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:10:58 2023] DELETE /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] [instance: ad7c2f89-c54f-4e78-b86d-88b4ab5daff4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:10:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] HTTP exception thrown: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Request method failure captured: Apr 14 12:10:58 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 HTTP/1.1 Apr 14 12:10:58 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:10:58 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:10:58 user devstack@n-api.service[61700]: Connection: close Apr 14 12:10:58 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:10:58 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:10:58 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:10:58 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:10:58 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOT-AOYAJ8sPGQB4zLXk0Ap8y_6XoAbpysDz4oPVWpuakupBht5-BJmZQTGPtc8vPgScI5wuH_5CEi0ndh7xzpme54JWP1I953p7NMZpwQPHhHhngVWHR0ln98liul1bdVQq4xK4xCTjUfMqXuYOqaD0fC46H7cynuIPEl-uEd-7v84g Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Project-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc13fb093d2745e8ba0152533140b6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc13fb093d2745e8ba0152533140b6f2"}]}] Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Tenant-Id: cc13fb093d2745e8ba0152533140b6f2 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1457966394 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:58 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:10:58 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:10:58 user devstack@n-api.service[61700]: X-User-Id: 260d1d4ef5a1422f84f9d91224b53952 Apr 14 12:10:58 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1457966394-project-member Apr 14 12:10:58 user devstack@n-api.service[61700]: method: > Apr 14 12:10:58 user devstack@n-api.service[61700]: exception: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61700]: action_args: {'id': 'ad7c2f89-c54f-4e78-b86d-88b4ab5daff4'} Apr 14 12:10:58 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. Apr 14 12:10:58 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:10:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] Returning 404 to user: Instance ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:10:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-075ce8e7-9935-4e8d-be96-83d4fc3b27c9 tempest-AttachVolumeShelveTestJSON-1457966394 tempest-AttachVolumeShelveTestJSON-1457966394-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4" status: 404 len: 111 microversion: 2.20 time: 0.049542 Apr 14 12:10:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 224/669] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:10:58 2023] GET /compute/v2.1/servers/ad7c2f89-c54f-4e78-b86d-88b4ab5daff4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:02 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-cffad34c-67c5-43d4-a0c3-75f4e832953e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1730 microversion: 2.1 time: 0.159188 Apr 14 12:11:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 225/670] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:11:02 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a38e822f-8f45-42ab-83cf-39892a4d0506 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.148971 Apr 14 12:11:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 222/671] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:11:07 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:08 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] Creating event network-changed:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:11:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b626138a-745f-4c4c-a8f6-5a3369a15ab0 req-b70cf9d5-f081-44ae-ae8e-4fbac07113b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046769 Apr 14 12:11:08 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 225/672] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:08 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lazy-loading 'services' on Instance uuid 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:11:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d4c6e5c2-4013-4d41-8a36-a7dd6af773c1 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments/456eefe5-dfcc-43aa-bb82-87ee292ece79" status: 202 len: 0 microversion: 2.1 time: 0.182951 Apr 14 12:11:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 226/673] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:11:08 2023] DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments/456eefe5-dfcc-43aa-bb82-87ee292ece79 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ec2d719e-6f2a-40f1-9620-b3304ec6e944 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Apr 14 12:11:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 223/674] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:11:08 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e21c997f-772e-4a1d-9cfd-4af032d3ebbf tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: .version_select at 0x7f43718fb910>, body: {"keypair": {"name": "tempest-keypair-529761837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZiArmd/vWKKYzoQ6L+5QXt6NQ93tkWUuWQkmHMFr1FiaeZK8oYFUEi4J6rAyA4xjPLPkXJ52r+f8ZLO7PYQDQRjHWPz99z84UyPxIBeU+3XTrfvpVR/SsklFdn4/ngA=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:09 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e21c997f-772e-4a1d-9cfd-4af032d3ebbf tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for project 90ff3910da7c47e9828549306fda25d7. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:11:09 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e21c997f-772e-4a1d-9cfd-4af032d3ebbf tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for user b7a65855384e4146a344cceb744e3e40 and project 90ff3910da7c47e9828549306fda25d7. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:11:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e21c997f-772e-4a1d-9cfd-4af032d3ebbf tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153918 Apr 14 12:11:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 226/675] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:11:08 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:10 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] Creating event network-changed:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:11:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-200f1f29-386e-40c2-9587-b376432fa8e0 req-c98d1d73-0526-45f6-8b4f-d25ce0c4fca5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028594 Apr 14 12:11:10 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 227/676] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:10 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1732004801", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8f65a07f-a522-4aac-a358-42db7baf614d"}], "security_groups": [{"name": "tempest-securitygroup--1325135632"}], "key_name": "tempest-keypair-529761837", "user_data": "}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:10 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] validate_networks() for [('8f65a07f-a522-4aac-a358-42db7baf614d', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for project 90ff3910da7c47e9828549306fda25d7. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for user b7a65855384e4146a344cceb744e3e40 and project 90ff3910da7c47e9828549306fda25d7. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:11:11 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:11:11 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-41aff329-0ea2-40c0-891f-50d026b1fe69 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.784322 Apr 14 12:11:11 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 224/677] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:11:10 2023] POST /compute/v2.1/servers => generated 400 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:11:11 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-47ab6485-9e2f-4611-ac9a-3e0dab1456e3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:11 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-47ab6485-9e2f-4611-ac9a-3e0dab1456e3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:11 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-47ab6485-9e2f-4611-ac9a-3e0dab1456e3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:11 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-47ab6485-9e2f-4611-ac9a-3e0dab1456e3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1231 microversion: 2.1 time: 0.067039 Apr 14 12:11:11 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 227/678] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:11:11 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1231 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:12 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2134e63e-0ab4-488a-a4f4-9d593587b62e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 200 len: 1392 microversion: 2.1 time: 0.174716 Apr 14 12:11:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 228/679] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:11:11 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] Creating event network-changed:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:11:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-961e394d-2f8c-4288-8c6c-2b152c76dcda req-a3f29fd3-76da-4a16-bcdb-6ff17e9e9c17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031965 Apr 14 12:11:14 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 225/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:11:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-77beec0a-53ec-4426-aa34-778141929bc7 req-7945db52-7a85-41b6-98b2-26cf7a98834d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044195 Apr 14 12:11:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 228/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "965e6d90-55dd-4a82-8b48-be9feeb0a867"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:16 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lazy-loading 'flavor' on Instance uuid b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:11:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-34387efe-41da-4b54-b1bd-ab06b1cdb9a4 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/action" status: 200 len: 29 microversion: 2.87 time: 0.498676 Apr 14 12:11:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 229/682] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:11:16 2023] POST /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/action => generated 29 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:17 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:17 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:17 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a9fe12aa-82df-4e09-a174-17889a98ad80 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1775 microversion: 2.87 time: 0.254916 Apr 14 12:11:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 226/683] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:11:16 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1775 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:11:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-unplugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:17 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] Creating event network-vif-unplugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:11:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-22eb6a50-68e1-4789-addb-857c981ba4a0 req-1adfda7d-d633-49e2-80ec-1a1ab7d6852e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039581 Apr 14 12:11:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 229/684] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:11:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f4908364-b26d-4b95-9e5b-b32a369b8d33 req-1df2d66e-748d-4310-94d7-8aff4dd8c4fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054669 Apr 14 12:11:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 230/685] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:11:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-fbd420b4-bda6-4a95-91cb-c9b6944abc08 req-72165bff-7c05-4340-a751-006bc3563792 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073567 Apr 14 12:11:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 227/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:11:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-aa59a257-a7d2-4384-9160-5968ede870b0 req-67e2f922-0046-42d8-ab9b-cb7059e6340f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038834 Apr 14 12:11:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=17 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:11:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ba8bd0c7-b993-4a0d-9bae-a79cfdfa145b req-098ce8aa-442b-44f5-9ca0-54e03a872c40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Apr 14 12:11:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 231/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=24 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:48 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6f51853194dd7931111ff84ea10fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f89371d6c614961849733631ca6be66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-511409cf-1e2f-4ec8-8ea9-571c08c2aa47 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 200 len: 1567 microversion: 2.1 time: 0.163921 Apr 14 12:11:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 228/689] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:11:48 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] Creating event network-changed:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:11:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-24909c67-e760-4131-b826-f94f26b3167b req-b5273dcc-152c-4971-b34a-e26ee8e8eeaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051750 Apr 14 12:11:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 231/690] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "024cd216-6cc1-4d77-b289-271450a7fe62"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b91af550-a8b9-4874-8cef-33bdc22df11c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396161 Apr 14 12:11:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 232/691] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:11:53 2023] POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1a61b6a2-1a87-4a12-ae98-bfcd0e96ee23 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049478 Apr 14 12:11:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 229/692] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:11:58 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:59 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:11:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ce33ea9f-17a7-4a7c-bd3c-b8bbb88b065d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 204 len: 0 microversion: 2.1 time: 0.140390 Apr 14 12:11:59 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 232/693] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:11:59 2023] DELETE /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:59 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:11:59 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3c410f27-377d-4caa-970d-1b5a37fdf820 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 200 len: 1679 microversion: 2.1 time: 0.176056 Apr 14 12:11:59 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 233/694] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:11:59 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:11:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:11:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:11:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:11:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:11:59 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] Creating event network-vif-unplugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:11:59 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-459c4bbf-3a0e-4a4c-894a-c1a9c479a124 req-3b6036e1-edee-46d0-a96d-a28e32caff63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027816 Apr 14 12:11:59 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 230/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:01 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-deleted", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:01 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] Creating event network-vif-deleted:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:12:01 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-9d1d721a-f618-44b6-8ea8-a8d2147df9c9 req-112ceb4b-e370-4a95-8538-95a97046e5c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Apr 14 12:12:01 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 233/696] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:01 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4595c0e6-f2af-47ef-b26e-7b1ccb58aa47", "name": "network-vif-plugged", "status": "completed", "tag": "3ba9407c-344c-45b8-a483-36e0c0e72ff0"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:01 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] Creating event network-vif-plugged:3ba9407c-344c-45b8-a483-36e0c0e72ff0 for instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 on user Apr 14 12:12:01 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-475d2d7d-9c78-42d1-ac7a-e23bcdaaa2e1 req-c22fd980-d8e0-4f3e-838e-b778ea1705fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028730 Apr 14 12:12:01 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 234/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:01 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9684ab4e-e4bd-4f93-ac3f-7b172420d42a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1537 microversion: 2.1 time: 0.172042 Apr 14 12:12:01 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 231/698] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:01 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1537 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a93ee33b-3c9b-4edc-8c8a-5ca07bafc085 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action" status: 202 len: 0 microversion: 2.1 time: 0.192333 Apr 14 12:12:02 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 234/699] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:12:02 2023] POST /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:02 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-62bf9bf9-b757-4709-94fe-3b60d8d9b82a tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1729 microversion: 2.1 time: 0.157676 Apr 14 12:12:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 235/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:02 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:12:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:03 user devstack@n-api.service[61701]: DEBUG nova.compute.api [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:12:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-11c40a2c-d36f-4e37-89ec-93150b7c009e req-9a1fb10f-7918-48ab-aced-52c335b49fa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045121 Apr 14 12:12:03 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 232/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:05 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:05 user devstack@n-api.service[61700]: DEBUG nova.compute.api [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:12:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-0360490f-385d-4773-ae12-80e5031219a0 req-104fad47-2a7d-4dfb-82ff-74d14ae15ae0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.043728 Apr 14 12:12:05 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 235/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:05 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:07 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-64fb813a-8652-43ad-a5ee-17e1c3d557c9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1755 microversion: 2.87 time: 0.162121 Apr 14 12:12:07 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 236/703] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:12:07 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:12 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d832a645-e4fc-47df-822d-25b864a8670c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 200 len: 1392 microversion: 2.1 time: 0.257760 Apr 14 12:12:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 233/704] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:12 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1913474144"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:12 user devstack@n-api.service[61700]: INFO nova.compute.api [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Attempting to quiesce instance before volume snapshot. Apr 14 12:12:12 user devstack@n-api.service[61700]: INFO nova.compute.api [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 12:12:12 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Creating snapshot from volume c08cb094-2346-4a3a-9cd4-758810dd7f07. {{(pid=61700) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:13 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'services' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:12:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-438d9be2-e315-466c-9264-a4e09f1662e1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/024cd216-6cc1-4d77-b289-271450a7fe62" status: 202 len: 0 microversion: 2.1 time: 0.169402 Apr 14 12:12:13 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 237/705] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:12:13 2023] DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/024cd216-6cc1-4d77-b289-271450a7fe62 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6e8a902f-a489-453f-a48d-a9814093365c tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047495 Apr 14 12:12:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 234/706] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:12:13 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-6cf4c33a-511a-4c41-bd23-92682a7fc4fc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590/action" status: 202 len: 0 microversion: 2.1 time: 2.775568 Apr 14 12:12:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 236/707] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:12:12 2023] POST /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590/action => generated 0 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 12:12:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1534345749", "imageRef": "30788121-99e9-48c7-9bac-0c68400ba1d3", "flavorRef": "42", "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:16 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:12:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:12:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0106cd6f-424a-4725-970f-d866e846edb4 req-c6adda7e-eb19-4773-8bd1-12326051c444 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042573 Apr 14 12:12:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:12:17 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='105d85cc-e8ed-4bbb-b801-c91707eeafd6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:12:17 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c070d0bd-c23d-4480-bc0f-e1b2f29fd559 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.825811 Apr 14 12:12:17 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 238/709] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:12:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:12:17 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-089e5ec7-cb47-47e1-9694-4bef541594fe tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:17 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-089e5ec7-cb47-47e1-9694-4bef541594fe tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:17 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-089e5ec7-cb47-47e1-9694-4bef541594fe tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:17 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-089e5ec7-cb47-47e1-9694-4bef541594fe tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 200 len: 1224 microversion: 2.1 time: 0.100425 Apr 14 12:12:17 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:17 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:12:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:12:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-503e127c-b45a-41b3-a2a8-5460d5dda0a4 req-50ca4850-b2e6-4391-aa68-c2a063bf1fa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038754 Apr 14 12:12:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 236/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] Creating event network-changed:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:12:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-bc641be6-d7e6-47c2-ae87-e104480cd05a req-3009a7ee-754d-4263-bc24-0fbee17c630a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048543 Apr 14 12:12:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 239/712] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "name": "network-vif-plugged", "status": "completed", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] Creating event network-vif-plugged:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:12:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-aa5c7168-f336-44b2-8326-fb9da42c7575 req-80d2a6ae-9a21-4113-b5f8-aeb806b2f950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100645 Apr 14 12:12:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 238/713] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=36 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "name": "network-vif-plugged", "status": "completed", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] Creating event network-vif-plugged:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:12:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-648c080e-af35-45a0-b087-6e95a3dd68b7 req-326a1c2c-2811-4726-a758-9f2b5a72f772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052194 Apr 14 12:12:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 237/714] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HTTP exception thrown: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Request method failure captured: Apr 14 12:12:49 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 HTTP/1.1 Apr 14 12:12:49 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:12:49 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:12:49 user devstack@n-api.service[61699]: Connection: close Apr 14 12:12:49 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:12:49 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:12:49 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:12:49 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:12:49 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-C9tpHsLruDVTR0wMVP0JRY5wOhKQtycKsYhc-XXk2kYrqcy8r1SONI4mGY7erU46n2nC8PTNnUHogLYf2cSRjef0D9q6JPq1zx-OFsDvX-9rBy0ZayzoXcJuJWuipRYIXF1iz5-PJpHxg_HJGuoaSq17PLUZjtQt7FxBoM6mLbFo Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Project-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f042abdcef8f41488e8f4624c2f4970b"}]}] Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Tenant-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:12:49 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:12:49 user devstack@n-api.service[61699]: X-User: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:12:49 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:12:49 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:12:49 user devstack@n-api.service[61699]: X-User-Id: 263c47076ee94cfaaa34eff928a36fdd Apr 14 12:12:49 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:12:49 user devstack@n-api.service[61699]: method: > Apr 14 12:12:49 user devstack@n-api.service[61699]: exception: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. Apr 14 12:12:49 user devstack@n-api.service[61699]: action_args: {'id': '4595c0e6-f2af-47ef-b26e-7b1ccb58aa47'} Apr 14 12:12:49 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. Apr 14 12:12:49 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:12:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Returning 404 to user: Instance 4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:12:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-5a9c43b5-b646-4205-ae97-0416719a7ec3 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47" status: 404 len: 111 microversion: 2.1 time: 0.041332 Apr 14 12:12:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 240/715] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:49 2023] GET /compute/v2.1/servers/4595c0e6-f2af-47ef-b26e-7b1ccb58aa47 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:12:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:49 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-efce2606-6d5d-48da-af1c-34cb4812b1d6 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '.version_select at 0x7f4371608550>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-efce2606-6d5d-48da-af1c-34cb4812b1d6 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239489635" status: 202 len: 0 microversion: 2.1 time: 0.026855 Apr 14 12:12:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 239/716] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:12:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239489635 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:52 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-12b3068b-204a-4fe0-b188-f3b92265ac76 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.149724 Apr 14 12:12:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 238/717] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:52 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:57 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:12:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-839ec16a-a7c0-45eb-9f6d-8f129778118a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 204 len: 0 microversion: 2.1 time: 0.133828 Apr 14 12:12:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 241/718] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:12:56 2023] DELETE /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:57 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:12:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0740115f-0508-4274-babc-8a79fe4bec1d tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 200 len: 1496 microversion: 2.1 time: 0.387456 Apr 14 12:12:57 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:12:57 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 1496 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:12:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-unplugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] Creating event network-vif-unplugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 12:12:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-acf41ed8-576f-47d1-9d56-04dd32e7c88f req-77b10794-9f1a-408b-baa6-14e2c82e10e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033435 Apr 14 12:12:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 239/720] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-deleted", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] Creating event network-vif-deleted:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 12:12:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-94644164-e756-4d08-91e6-e49552f9e8fc req-8670d5d0-1b8a-414c-9372-020c25feef46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106341 Apr 14 12:12:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 242/721] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:12:59 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b119-b1c9-47ce-b325-5a4730aef707", "name": "network-vif-plugged", "status": "completed", "tag": "e5175890-c267-454b-b532-70223beb1f72"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:12:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:12:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:12:59 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:12:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] Creating event network-vif-plugged:e5175890-c267-454b-b532-70223beb1f72 for instance 68f7b119-b1c9-47ce-b325-5a4730aef707 on user Apr 14 12:12:59 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-137ff408-1410-434c-904c-16a117f79116 req-4a17b0ef-1d5d-4f61-ad49-40cd38f48d86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045226 Apr 14 12:12:59 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 241/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:12:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-7ccc5452-2e33-4b83-a671-2d8206677d3a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.088670 Apr 14 12:13:01 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 240/723] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:13:01 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] Creating event network-changed:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:13:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-14f64084-373a-40df-8b16-3f49a7f763ea req-03616ce7-2f05-4424-b2b4-db7047ec931f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032467 Apr 14 12:13:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 243/724] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-4b9dd837-60ef-422a-b9b9-060f5f5c732b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/ips" status: 200 len: 104 microversion: 2.1 time: 0.042710 Apr 14 12:13:02 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:13:02 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/ips => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:03 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:03 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-439073ae-ad84-40cf-97b2-e76c7bdfea87 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048065 Apr 14 12:13:03 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:13:03 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7daf6afe-aa4a-41fd-a6fd-2594e88abfdb"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:05 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f088d82d-c9fa-450d-a925-8e7e1d3ea839 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292144 Apr 14 12:13:05 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 244/727] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:13:05 2023] POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51fa6908-5d02-4957-afda-68b84f2323e1"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-afb06267-23df-4db1-9507-215947a091f1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319132 Apr 14 12:13:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 243/728] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:13:07 2023] POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e1641098-fa95-4beb-b7bf-4a22981eb6a9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/action" status: 202 len: 0 microversion: 2.87 time: 0.087481 Apr 14 12:13:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 242/729] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 12:13:07 2023] POST /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:07 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b4e513ff-0131-426b-950f-a7b77e587e92 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 200 len: 1549 microversion: 2.1 time: 0.157648 Apr 14 12:13:07 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 245/730] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:07 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:07 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-88788281-5f41-487b-94e6-46c5a64a500a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1763 microversion: 2.87 time: 0.215007 Apr 14 12:13:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 244/731] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:13:07 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1763 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:13:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-unplugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] Creating event network-vif-unplugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:13:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-636addc0-7d79-4869-8563-8157f058bf89 req-06d03949-1163-4d95-b5c7-d976e3130644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036168 Apr 14 12:13:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 243/732] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:10 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}, {"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:13:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:13:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-bf88862f-1d7b-4de5-b6d4-b22b7519dbdd req-7289c233-63dc-4668-84b7-8813e6e224a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071718 Apr 14 12:13:10 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 246/733] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:13:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-c8ae6daa-87f4-4f33-a26f-e27abbdc782a req-706d501f-af1b-4337-bd90-63a7afa70c23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035219 Apr 14 12:13:12 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 245/734] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:13 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:13 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:13 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Going to try to stop instance {{(pid=61701) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 12:13:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-75c0c7b4-1053-4226-b9f3-b3be569e8af3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action" status: 202 len: 0 microversion: 2.1 time: 0.117833 Apr 14 12:13:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 244/735] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:13:13 2023] POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:13 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:13 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9416b977-d867-4eeb-9114-7c595b56dd2c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1712 microversion: 2.1 time: 0.159593 Apr 14 12:13:13 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 247/736] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:13 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:13:13 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-unplugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:13 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] Creating event network-vif-unplugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:13:13 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-4b638409-c076-45f6-b8bd-74022819d26c req-368cb804-e58b-4a0c-9dee-1f7569730ec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049539 Apr 14 12:13:13 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 246/737] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:13:15 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-4da2be09-11bf-46e8-9fae-f29057540a80 req-1c36131b-b98e-41be-b5f8-f7ad4dd5119d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028966 Apr 14 12:13:15 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 248/738] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:16 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'services' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:13:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-47fc0a47-3cf1-43b7-8b97-535fff1f7a9d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/51fa6908-5d02-4957-afda-68b84f2323e1" status: 202 len: 0 microversion: 2.1 time: 0.588798 Apr 14 12:13:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 245/739] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:13:15 2023] DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/51fa6908-5d02-4957-afda-68b84f2323e1 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a2710c32-8ac5-480f-938c-750c049dff06 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054038 Apr 14 12:13:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 247/740] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:13:16 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 68f7b119-b1c9-47ce-b325-5a4730aef707] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HTTP exception thrown: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Request method failure captured: Apr 14 12:13:47 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 HTTP/1.1 Apr 14 12:13:47 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:13:47 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:13:47 user devstack@n-api.service[61699]: Connection: close Apr 14 12:13:47 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:13:47 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:13:47 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:13:47 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:13:47 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-C9tpHsLruDVTR0wMVP0JRY5wOhKQtycKsYhc-XXk2kYrqcy8r1SONI4mGY7erU46n2nC8PTNnUHogLYf2cSRjef0D9q6JPq1zx-OFsDvX-9rBy0ZayzoXcJuJWuipRYIXF1iz5-PJpHxg_HJGuoaSq17PLUZjtQt7FxBoM6mLbFo Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Project-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f042abdcef8f41488e8f4624c2f4970b"}]}] Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Tenant-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:13:47 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:13:47 user devstack@n-api.service[61699]: X-User: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:13:47 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:13:47 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:13:47 user devstack@n-api.service[61699]: X-User-Id: 263c47076ee94cfaaa34eff928a36fdd Apr 14 12:13:47 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:13:47 user devstack@n-api.service[61699]: method: > Apr 14 12:13:47 user devstack@n-api.service[61699]: exception: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. Apr 14 12:13:47 user devstack@n-api.service[61699]: action_args: {'id': '68f7b119-b1c9-47ce-b325-5a4730aef707'} Apr 14 12:13:47 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. Apr 14 12:13:47 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:13:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Returning 404 to user: Instance 68f7b119-b1c9-47ce-b325-5a4730aef707 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:13:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-950559cb-13a6-4c16-b55a-71576d1faf46 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707" status: 404 len: 111 microversion: 2.1 time: 0.155164 Apr 14 12:13:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:47 2023] GET /compute/v2.1/servers/68f7b119-b1c9-47ce-b325-5a4730aef707 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:13:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c8558195-c01d-4e9f-b13e-3f28e03cf72a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 204 len: 0 microversion: 2.1 time: 0.146181 Apr 14 12:13:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 246/742] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:13:47 2023] DELETE /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:48 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263c47076ee94cfaaa34eff928a36fdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f042abdcef8f41488e8f4624c2f4970b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3e1bfdc8-78e1-430a-ac25-40b10afe440a tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 200 len: 1510 microversion: 2.1 time: 0.201637 Apr 14 12:13:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 248/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:47 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:13:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-unplugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] Creating event network-vif-unplugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:13:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8b2c2bf2-1510-4cee-b9d6-62abe46fe156 req-b27eaeef-cdd7-47bc-8264-e09d41ecfd39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029541 Apr 14 12:13:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 250/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:50 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-plugged", "status": "completed", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}, {"server_uuid": "16a25a1d-bc8b-4de0-b975-037aee0d46ee", "name": "network-vif-deleted", "tag": "e6abe9bd-ec11-4204-9e3d-79e395495588"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:13:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Creating event network-vif-plugged:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:13:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] Creating event network-vif-deleted:e6abe9bd-ec11-4204-9e3d-79e395495588 for instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee on user Apr 14 12:13:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-bcf71e38-2346-4813-ac59-6cf5b04e7c48 req-e41b372c-dae7-460f-9eb8-27ae44ebcac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038035 Apr 14 12:13:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 247/745] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:13:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:53 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8d2f1031-d642-47e5-ad3c-7d402c71671e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.202838 Apr 14 12:13:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 249/746] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:52 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:53 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-cf2b08eb-333f-4d73-a3ec-34d4b07b2be3 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1722 microversion: 2.1 time: 0.161804 Apr 14 12:13:53 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 251/747] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:13:53 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:13:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:13:58 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:58 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:58 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:13:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-799e8091-61c4-47ba-82c7-3b8bb4fc69b9 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1769 microversion: 2.87 time: 0.278788 Apr 14 12:13:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 248/748] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:13:57 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1769 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=12 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:03 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:03 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-55ed9fa5-dd2c-44f9-8e52-1091e1f81eea tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1689 microversion: 2.1 time: 0.178399 Apr 14 12:14:03 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 250/749] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:03 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=10 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d40338a8-1d55-4143-bbb6-c644e5643b5e tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049714 Apr 14 12:14:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 252/750] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:14:06 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:07 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2bbd2b59-966b-4d95-a28c-ad3063e4bf89 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 200 len: 1549 microversion: 2.1 time: 0.148353 Apr 14 12:14:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 249/751] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:07 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:08 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:14:08 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8566249e-c8f1-42b1-bf32-4a382a4861eb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 204 len: 0 microversion: 2.1 time: 0.122696 Apr 14 12:14:08 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 251/752] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:14:07 2023] DELETE /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:08 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:08 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-efced777-c295-438a-a99e-52cd0717e8d5 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 200 len: 1555 microversion: 2.1 time: 0.221337 Apr 14 12:14:08 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 253/753] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:08 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "name": "network-vif-unplugged", "status": "completed", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] Creating event network-vif-unplugged:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:14:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9fbb69db-b7dd-4644-a28b-698f7f4be8a5 req-9f07377f-f9a0-44e9-acb3-163f50e46821 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030204 Apr 14 12:14:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 250/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "name": "network-vif-deleted", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] Creating event network-vif-deleted:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:14:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-8f17622c-77c4-492e-b6b3-8ec9d1080ccc req-d905505b-e1a7-49cb-aff4-2afa7289bd99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030912 Apr 14 12:14:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 252/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b0841df-a3c9-4fb3-8685-44b2a2bb3923"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f6250305-65ab-4846-8355-afb9ed5a41a1 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280733 Apr 14 12:14:10 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 254/756] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:14:10 2023] POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:10 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c659b3a7-fdf1-4513-8202-770d21f731b2", "name": "network-vif-plugged", "status": "completed", "tag": "74de70a0-4308-49c6-bef0-449f745b6085"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:10 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:10 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] Creating event network-vif-plugged:74de70a0-4308-49c6-bef0-449f745b6085 for instance c659b3a7-fdf1-4513-8202-770d21f731b2 on user Apr 14 12:14:10 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-f6409c7f-f6dc-4674-a76c-bffe3c19770d req-c7a7b45f-69c5-4b90-959c-2b4888083ce0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029798 Apr 14 12:14:10 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 251/757] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:18 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'services' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:14:18 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-d3372848-5da5-47d4-87ac-0fab9bf2b7f6 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/2b0841df-a3c9-4fb3-8685-44b2a2bb3923" status: 202 len: 0 microversion: 2.1 time: 0.212938 Apr 14 12:14:18 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 253/758] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:14:18 2023] DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/2b0841df-a3c9-4fb3-8685-44b2a2bb3923 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:18 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:18 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6e7ef13c-ea68-45d2-b113-25df4e9493a4 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Apr 14 12:14:18 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 255/759] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:14:18 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] [instance: 16a25a1d-bc8b-4de0-b975-037aee0d46ee] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] HTTP exception thrown: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Request method failure captured: Apr 14 12:14:38 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee HTTP/1.1 Apr 14 12:14:38 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:14:38 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:14:38 user devstack@n-api.service[61701]: Connection: close Apr 14 12:14:38 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:14:38 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:14:38 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:14:38 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:14:38 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOT-C9tpHsLruDVTR0wMVP0JRY5wOhKQtycKsYhc-XXk2kYrqcy8r1SONI4mGY7erU46n2nC8PTNnUHogLYf2cSRjef0D9q6JPq1zx-OFsDvX-9rBy0ZayzoXcJuJWuipRYIXF1iz5-PJpHxg_HJGuoaSq17PLUZjtQt7FxBoM6mLbFo Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Project-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f042abdcef8f41488e8f4624c2f4970b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f042abdcef8f41488e8f4624c2f4970b"}]}] Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Tenant-Id: f042abdcef8f41488e8f4624c2f4970b Apr 14 12:14:38 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-896417797 Apr 14 12:14:38 user devstack@n-api.service[61701]: X-User: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:14:38 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:14:38 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:14:38 user devstack@n-api.service[61701]: X-User-Id: 263c47076ee94cfaaa34eff928a36fdd Apr 14 12:14:38 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-896417797-project-member Apr 14 12:14:38 user devstack@n-api.service[61701]: method: > Apr 14 12:14:38 user devstack@n-api.service[61701]: exception: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. Apr 14 12:14:38 user devstack@n-api.service[61701]: action_args: {'id': '16a25a1d-bc8b-4de0-b975-037aee0d46ee'} Apr 14 12:14:38 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. Apr 14 12:14:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:14:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] Returning 404 to user: Instance 16a25a1d-bc8b-4de0-b975-037aee0d46ee could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:14:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1ff06f0d-be31-407b-93c9-af98df77e0c8 tempest-ServerRescueNegativeTestJSON-896417797 tempest-ServerRescueNegativeTestJSON-896417797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee" status: 404 len: 111 microversion: 2.1 time: 0.039664 Apr 14 12:14:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 252/760] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:38 2023] GET /compute/v2.1/servers/16a25a1d-bc8b-4de0-b975-037aee0d46ee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:14:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-988610230", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] validate_networks() for [('42f6438c-9c79-4fe5-875b-1b5b5b9b0dda', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting quotas for project 930c6e3aceb3445c8bed09847c92f271. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting quotas for user f4063336b73e44ed991ca650d60bb3cd and project 930c6e3aceb3445c8bed09847c92f271. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:14:49 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:14:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-e50fb7d0-4c42-490e-ae21-ba4f390cbf42 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.710728 Apr 14 12:14:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 254/761] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:14:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:14:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-487e576b-6dd2-4c2c-b76e-f61c9e6cc5d8 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:49 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-487e576b-6dd2-4c2c-b76e-f61c9e6cc5d8 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:49 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:49 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-487e576b-6dd2-4c2c-b76e-f61c9e6cc5d8 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-487e576b-6dd2-4c2c-b76e-f61c9e6cc5d8 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1210 microversion: 2.1 time: 0.073796 Apr 14 12:14:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 256/762] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:49 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1210 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] Creating event network-changed:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:14:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-731059e8-bbac-4ff3-b7c5-4f0f0bfc213d req-267bcc43-fc66-46eb-a22e-83a74fd25a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Apr 14 12:14:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 253/763] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:53 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:14:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-373142dd-009d-4402-8b0b-07d43a7325ed tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 204 len: 0 microversion: 2.1 time: 0.119184 Apr 14 12:14:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:14:53 2023] DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:53 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:53 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b56e8ff1-7c4d-4449-a1d9-b33f80c90c35 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 200 len: 1728 microversion: 2.1 time: 0.194782 Apr 14 12:14:53 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 257/765] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:53 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:53 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:53 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:53 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-6552d0bc-a576-46fb-ae0f-40caec5c2d19 req-4aa6f8b9-1a19-4163-b367-ff8c26018f57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032928 Apr 14 12:14:53 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 254/766] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:55 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "name": "network-vif-plugged", "status": "completed", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}, {"server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "name": "network-vif-plugged", "status": "completed", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}, {"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-plugged", "status": "completed", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:55 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-unplugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] Creating event network-vif-plugged:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-d9bdee97-d5a2-4a0a-8f69-8b396dd30abf req-d6ea9736-5e3d-4737-a711-372a4fa90cd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.048162 Apr 14 12:14:55 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 256/767] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 12:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:14:55 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e4aa91-7c03-46cc-8610-78f18bbd089f", "name": "network-vif-deleted", "tag": "d7cd0790-d778-4855-b7ad-c0b5c0258c1b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:55 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] Creating event network-vif-deleted:d7cd0790-d778-4855-b7ad-c0b5c0258c1b for instance 11e4aa91-7c03-46cc-8610-78f18bbd089f on user Apr 14 12:14:55 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6e3dc2d2-dc30-4b5f-847b-5f0e2b6a6983 req-d8830c87-059e-47f6-beaa-abb8c35bb9da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027087 Apr 14 12:14:55 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 258/768] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:14:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-98480a1d-d544-49c8-9be8-928dae12eb01 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 204 len: 0 microversion: 2.87 time: 0.128778 Apr 14 12:14:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 255/769] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:14:58 2023] DELETE /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:14:58 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 HTTP/1.1 Apr 14 12:14:58 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:14:58 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:14:58 user devstack@n-api.service[61699]: Connection: close Apr 14 12:14:58 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:14:58 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:14:58 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:14:58 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:14:58 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:14:58 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:14:58 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:14:58 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:14:58 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:14:58 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:14:58 user devstack@n-api.service[61699]: method: > Apr 14 12:14:58 user devstack@n-api.service[61699]: exception: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:14:58 user devstack@n-api.service[61699]: action_args: {'id': 'c659b3a7-fdf1-4513-8202-770d21f731b2'} Apr 14 12:14:58 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:14:58 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:14:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:14:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6ca82a26-9c88-4741-b05e-6e7c14eb95cb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 404 len: 111 microversion: 2.1 time: 0.037308 Apr 14 12:14:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 259/770] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:14:58 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:58 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:14:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bf679b98-49ab-4c8d-953d-0be0b4c6e76e tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 200 len: 1775 microversion: 2.87 time: 0.238224 Apr 14 12:14:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 257/771] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:14:58 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 1775 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-unplugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:14:58 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:14:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] Creating event network-vif-unplugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:14:58 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-2c695c34-d92e-4315-b136-69a115eb75cf req-797e6619-173e-44e2-8491-501a5bdc5fb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043885 Apr 14 12:14:58 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 256/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:14:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:00 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-plugged", "status": "completed", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}, {"server_uuid": "b5b4cd5e-d786-4c51-978b-7ff76e21d1b2", "name": "network-vif-deleted", "tag": "6facec09-5fc6-423c-9c30-9a1ca2ea0d05"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:00 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:00 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Creating event network-vif-plugged:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:15:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] Creating event network-vif-deleted:6facec09-5fc6-423c-9c30-9a1ca2ea0d05 for instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 on user Apr 14 12:15:00 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-6227140f-0c8a-4260-99c2-29a439597512 req-a8731e78-d6d0-407d-bf0f-08f135c20607 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037818 Apr 14 12:15:00 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 260/773] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:01 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:15:01 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9caa440b-713e-4b62-a37c-7160ba11c1dc tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 204 len: 0 microversion: 2.1 time: 0.112864 Apr 14 12:15:01 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 258/774] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:15:01 2023] DELETE /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:02 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9607aace-83e0-4e1d-b577-ed37c64973bb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 200 len: 1398 microversion: 2.1 time: 0.164708 Apr 14 12:15:02 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 257/775] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:01 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 1398 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:15:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "name": "network-vif-unplugged", "status": "completed", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] Creating event network-vif-unplugged:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:15:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-0de6fae7-a68d-4da5-82cb-d05b7006f9a9 req-98e5bb99-9b07-449a-aec6-4c9d788663fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108755 Apr 14 12:15:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 261/776] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:03 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:03 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:03 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Going to try to start instance {{(pid=61700) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 12:15:03 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "name": "network-vif-deleted", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-00031ddc-fb17-417d-b6ec-f4123fc2b5ed tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action" status: 202 len: 0 microversion: 2.1 time: 0.123894 Apr 14 12:15:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 259/777] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:15:03 2023] POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] Creating event network-vif-deleted:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-2c3feef3-4ee1-477d-b87c-0114e0ae2c0e req-83cf2924-0ba2-41a4-aa3c-06c04b1e0055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042000 Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 258/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:04 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6e728da0-b0a1-4cd3-9a25-48cca4a9a314 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1698 microversion: 2.1 time: 0.201246 Apr 14 12:15:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 262/779] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:04 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:15:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350d4ef-74fe-4642-b1fd-4f15e10db590", "name": "network-vif-plugged", "status": "completed", "tag": "39f99cae-b8a9-4ebd-840c-f124cba0415e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] Creating event network-vif-plugged:39f99cae-b8a9-4ebd-840c-f124cba0415e for instance b350d4ef-74fe-4642-b1fd-4f15e10db590 on user Apr 14 12:15:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-12b00955-aec3-4b0f-ae7a-e913b2fbcf25 req-7782e40b-bc3a-4ff3-bd99-a844049f0421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029487 Apr 14 12:15:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 260/780] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-39af524a-1717-434c-98f3-1fecf9451b15 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.217232 Apr 14 12:15:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 259/781] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:15:08 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:15:10 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:10 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:15:10 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b8b499c9-fb0b-4bba-b9f8-977ba9b79b5c req-911ae667-1243-46bb-9ae9-8b707b8e2a96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Apr 14 12:15:10 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 263/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:15:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-a769c086-1628-485a-aaab-b8627618974e req-86b4b178-ce0e-4c6c-979a-4e40bc076d1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045501 Apr 14 12:15:12 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 261/783] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1260950-5599-449f-aff8-e310ecfe5cf6"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:13 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-256d8517-e8d0-453c-825c-70af0301279d tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353043 Apr 14 12:15:13 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 260/784] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:15:12 2023] POST /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:20 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=18 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:20 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=22 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:21 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lazy-loading 'services' on Instance uuid a83e502a-7b98-4a46-ae3d-82339fbf07ca {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:15:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1e4229fc-58e1-44ea-a817-151ea27e5b08 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/c1260950-5599-449f-aff8-e310ecfe5cf6" status: 202 len: 0 microversion: 2.1 time: 0.162562 Apr 14 12:15:21 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 264/785] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:15:20 2023] DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments/c1260950-5599-449f-aff8-e310ecfe5cf6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:21 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:21 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b95c7491-7b67-45b8-86b7-f0a887263893 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.358677 Apr 14 12:15:21 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 262/786] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:15:21 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 197 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:39 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-3904d7e2-3bb9-42b2-acda-4db32cb8f4a0 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1492 microversion: 2.1 time: 0.216360 Apr 14 12:15:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 261/787] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:39 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1492 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:15:43 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f HTTP/1.1 Apr 14 12:15:43 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:15:43 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:15:43 user devstack@n-api.service[61699]: Connection: close Apr 14 12:15:43 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:15:43 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:15:43 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:15:43 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:15:43 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61699]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:15:43 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61699]: method: > Apr 14 12:15:43 user devstack@n-api.service[61699]: exception: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61699]: action_args: {'id': '11e4aa91-7c03-46cc-8610-78f18bbd089f'} Apr 14 12:15:43 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6fe762cc-57b8-4972-8dc6-d026c6045b8c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 404 len: 111 microversion: 2.1 time: 0.041829 Apr 14 12:15:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 265/788] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:43 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=5 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:15:43 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments HTTP/1.1 Apr 14 12:15:43 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:15:43 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:15:43 user devstack@n-api.service[61700]: Connection: close Apr 14 12:15:43 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:15:43 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:15:43 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:15:43 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:15:43 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61700]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:15:43 user devstack@n-api.service[61700]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61700]: method: > Apr 14 12:15:43 user devstack@n-api.service[61700]: exception: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61700]: action_args: {'server_id': '11e4aa91-7c03-46cc-8610-78f18bbd089f'} Apr 14 12:15:43 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:43 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-676ff4d6-bcfe-4bf8-8ef7-3cdf2f1509d0 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077733 Apr 14 12:15:43 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 263/789] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:15:43 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f/os-volume_attachments => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:43 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:15:43 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f HTTP/1.1 Apr 14 12:15:43 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:15:43 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:15:43 user devstack@n-api.service[61701]: Connection: close Apr 14 12:15:43 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:15:43 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:15:43 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:15:43 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:15:43 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:15:43 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:15:43 user devstack@n-api.service[61701]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:15:43 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:15:43 user devstack@n-api.service[61701]: method: > Apr 14 12:15:43 user devstack@n-api.service[61701]: exception: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61701]: action_args: {'id': '11e4aa91-7c03-46cc-8610-78f18bbd089f'} Apr 14 12:15:43 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:15:43 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:43 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8742e7dd-cdc3-45b3-8324-09f9f9d306be tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 404 len: 111 microversion: 2.1 time: 0.031420 Apr 14 12:15:43 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 262/790] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:43 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1318615277", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "12b17cd5-254d-41fb-b300-9968f8c873ec"}], "security_groups": [{"name": "tempest-securitygroup--1391015000"}], "key_name": "tempest-keypair-2086314618", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:44 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] validate_networks() for [('12b17cd5-254d-41fb-b300-9968f8c873ec', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:15:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:15:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-feadf3a3-e19c-4290-a6c5-a6a34c14e024 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.159887 Apr 14 12:15:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 266/791] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:15:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:15:45 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-4b00a41b-5a65-4985-b811-9aa91a69a6d5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:45 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-4b00a41b-5a65-4985-b811-9aa91a69a6d5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:45 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-4b00a41b-5a65-4985-b811-9aa91a69a6d5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-4b00a41b-5a65-4985-b811-9aa91a69a6d5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 200 len: 1233 microversion: 2.1 time: 0.116521 Apr 14 12:15:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 264/792] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:45 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 1233 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:15:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] Creating event network-changed:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:15:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-615ef0b6-a6ff-49ce-8467-3044b0fbd5c2 req-b6901a58-1caf-4144-a1b3-50382a96ad05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041683 Apr 14 12:15:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 263/793] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: b5b4cd5e-d786-4c51-978b-7ff76e21d1b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HTTP exception thrown: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Request method failure captured: Apr 14 12:15:48 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 HTTP/1.1 Apr 14 12:15:48 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:15:48 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:15:48 user devstack@n-api.service[61699]: Connection: close Apr 14 12:15:48 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:15:48 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:15:48 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:15:48 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:15:48 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-L6xGRXms-rc9ZUoOq_CJ40JB4-RIfEv30k8Q-N93ZkIFVrg0BrMKHIBa8D1agzzBShAkZk0tqqVBUWB4XZX7jtwUUvXl9HEeo0rII7h-Yc3pXLUMuszlUxa_zUjKpJtsOyMaNvRM_zXTFaNqtJ3J707HMIHUJAyg6pkzqLM0eLDs Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Project-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c5140d4419e43be941c2ac5d5439e35"}]}] Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Tenant-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:15:48 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:15:48 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:15:48 user devstack@n-api.service[61699]: X-User-Id: 11df88c60e4b456691d8731fe8facf38 Apr 14 12:15:48 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:15:48 user devstack@n-api.service[61699]: method: > Apr 14 12:15:48 user devstack@n-api.service[61699]: exception: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. Apr 14 12:15:48 user devstack@n-api.service[61699]: action_args: {'id': 'b5b4cd5e-d786-4c51-978b-7ff76e21d1b2'} Apr 14 12:15:48 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. Apr 14 12:15:48 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Returning 404 to user: Instance b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0ff40737-43c7-4eb8-9036-d53e46d6ebb7 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2" status: 404 len: 111 microversion: 2.87 time: 0.029991 Apr 14 12:15:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 267/794] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:15:48 2023] GET /compute/v2.1/servers/b5b4cd5e-d786-4c51-978b-7ff76e21d1b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:15:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-66aeb3d2-38ea-43b4-8a89-63f0b2b8a3e1 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 204 len: 0 microversion: 2.87 time: 0.137841 Apr 14 12:15:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 265/795] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:15:48 2023] DELETE /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:49 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:49 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:49 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1f15942a-be38-4b17-99ec-045dc2796e77 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 200 len: 1696 microversion: 2.87 time: 0.182417 Apr 14 12:15:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 264/796] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:15:48 2023] GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:15:49 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "name": "network-vif-unplugged", "status": "completed", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:49 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] Creating event network-vif-unplugged:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:15:49 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-cc349d52-ffa5-48cc-acc5-e4fea0f83a3d req-110e0813-a72b-41c6-aaef-68bb8687a4cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027355 Apr 14 12:15:49 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 268/797] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "name": "network-vif-plugged", "status": "completed", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] Creating event network-vif-plugged:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:15:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-1e4525e4-ec6a-4c32-898a-5deed14d95d8 req-af098fbb-d83d-4ade-8a84-db1c9ed52d34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040892 Apr 14 12:15:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 266/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "name": "network-vif-plugged", "status": "completed", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] Creating event network-vif-plugged:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:15:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e1402d2c-e7b0-41a9-b4f8-c3338f107bf1 req-bb4f1cff-f968-4875-b38c-e0fa6a2fe0dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Apr 14 12:15:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 265/799] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:15:52 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 HTTP/1.1 Apr 14 12:15:52 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:15:52 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:15:52 user devstack@n-api.service[61699]: Connection: close Apr 14 12:15:52 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:15:52 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:15:52 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:15:52 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:15:52 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61699]: method: > Apr 14 12:15:52 user devstack@n-api.service[61699]: exception: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: action_args: {'id': 'b350d4ef-74fe-4642-b1fd-4f15e10db590'} Apr 14 12:15:52 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-dbe856c7-a4c5-48e6-a8f8-28de59d9d5fb tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 404 len: 111 microversion: 2.1 time: 0.028056 Apr 14 12:15:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 269/800] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:52 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "name": "network-vif-plugged", "status": "completed", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}, {"server_uuid": "545be51c-649c-4297-a924-bbb6ecf303dd", "name": "network-vif-deleted", "tag": "2a8170c7-6a56-4654-a6ef-95dc8f0957dd"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Creating event network-vif-plugged:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:15:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] Creating event network-vif-deleted:2a8170c7-6a56-4654-a6ef-95dc8f0957dd for instance 545be51c-649c-4297-a924-bbb6ecf303dd on user Apr 14 12:15:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:15:52 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 HTTP/1.1 Apr 14 12:15:52 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:15:52 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:15:52 user devstack@n-api.service[61701]: Connection: close Apr 14 12:15:52 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:15:52 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:15:52 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:15:52 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:15:52 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61701]: method: > Apr 14 12:15:52 user devstack@n-api.service[61701]: exception: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: action_args: {'id': 'c659b3a7-fdf1-4513-8202-770d21f731b2'} Apr 14 12:15:52 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-72ce2e55-c402-4504-ba85-4ddc5783c047 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 404 len: 111 microversion: 2.1 time: 0.027935 Apr 14 12:15:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:15:52 2023] DELETE /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-17a8d159-b91f-46ba-8f5b-309e90639156 req-e1eadcc7-6644-4a31-b94a-0b3640e10b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032883 Apr 14 12:15:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 267/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: c659b3a7-fdf1-4513-8202-770d21f731b2] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:15:52 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 HTTP/1.1 Apr 14 12:15:52 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:15:52 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:15:52 user devstack@n-api.service[61699]: Connection: close Apr 14 12:15:52 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:15:52 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:15:52 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:15:52 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:15:52 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:15:52 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61699]: method: > Apr 14 12:15:52 user devstack@n-api.service[61699]: exception: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: action_args: {'id': 'c659b3a7-fdf1-4513-8202-770d21f731b2'} Apr 14 12:15:52 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance c659b3a7-fdf1-4513-8202-770d21f731b2 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-14ed9b21-c89e-4cbd-9277-a8f024212090 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2" status: 404 len: 111 microversion: 2.1 time: 0.029201 Apr 14 12:15:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 270/803] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:52 2023] GET /compute/v2.1/servers/c659b3a7-fdf1-4513-8202-770d21f731b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:15:52 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 HTTP/1.1 Apr 14 12:15:52 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:15:52 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:15:52 user devstack@n-api.service[61701]: Connection: close Apr 14 12:15:52 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:15:52 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:15:52 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:15:52 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:15:52 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:15:52 user devstack@n-api.service[61701]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61701]: method: > Apr 14 12:15:52 user devstack@n-api.service[61701]: exception: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: action_args: {'id': 'b350d4ef-74fe-4642-b1fd-4f15e10db590'} Apr 14 12:15:52 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f04d10e8-8fbe-4b57-ad18-2fe7e148d270 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 404 len: 111 microversion: 2.1 time: 0.034974 Apr 14 12:15:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 267/804] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:15:52 2023] DELETE /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: b350d4ef-74fe-4642-b1fd-4f15e10db590] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:15:52 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 HTTP/1.1 Apr 14 12:15:52 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:15:52 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:15:52 user devstack@n-api.service[61700]: Connection: close Apr 14 12:15:52 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:15:52 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:15:52 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:15:52 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:15:52 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:15:52 user devstack@n-api.service[61700]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:15:52 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:15:52 user devstack@n-api.service[61700]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:15:52 user devstack@n-api.service[61700]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:15:52 user devstack@n-api.service[61700]: method: > Apr 14 12:15:52 user devstack@n-api.service[61700]: exception: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61700]: action_args: {'id': 'b350d4ef-74fe-4642-b1fd-4f15e10db590'} Apr 14 12:15:52 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. Apr 14 12:15:52 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:15:52 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance b350d4ef-74fe-4642-b1fd-4f15e10db590 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:15:52 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f12c0f50-adaa-4b25-b51d-9326d8501bef tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590" status: 404 len: 111 microversion: 2.1 time: 0.032610 Apr 14 12:15:52 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 268/805] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:52 2023] GET /compute/v2.1/servers/b350d4ef-74fe-4642-b1fd-4f15e10db590 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8d899682-5c7e-4c9e-9cca-6a49d001836a tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: .version_select at 0x7f43716e20e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-582531121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKktBOa+5oiNUDvZJSErbDsR7IphRupPCdhNWjbZr/csFSban5TwU550R6B/g8IhOECNdrtAHdWni2HQxKugYQDa7DhJ5PxIBXtX/h5r3Kj1TL7S/5fceRiLkMg8UuEHRA=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-8d899682-5c7e-4c9e-9cca-6a49d001836a tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:15:52 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-8d899682-5c7e-4c9e-9cca-6a49d001836a tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:15:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8d899682-5c7e-4c9e-9cca-6a49d001836a tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.042782 Apr 14 12:15:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 271/806] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:15:52 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:54 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-cb216f0e-b2db-4645-9116-f547c3225eb3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1702 microversion: 2.1 time: 0.160726 Apr 14 12:15:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 268/807] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:54 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:15:57 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-622304930", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-582531121", "security_groups": [{"name": "tempest-secgroup-smoke-388343603"}], "block_device_mapping_v2": [{"uuid": "e8c18af9-e524-4926-993c-10728f35875a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:15:58 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8c18af9-e524-4926-993c-10728f35875a',volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:15:58 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ae6cf5eb-b5e3-4f97-9930-81dc5d6556ff tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.752466 Apr 14 12:15:58 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 269/808] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:15:57 2023] POST /compute/v2.1/servers => generated 403 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:15:58 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:15:58 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-8fe77646-515f-4d01-a9a5-ae59bd30ab0f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:15:58 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-8fe77646-515f-4d01-a9a5-ae59bd30ab0f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:15:58 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-8fe77646-515f-4d01-a9a5-ae59bd30ab0f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:15:58 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-8fe77646-515f-4d01-a9a5-ae59bd30ab0f tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 200 len: 1088 microversion: 2.1 time: 0.077214 Apr 14 12:15:58 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 272/809] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:15:58 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:01 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] Creating event network-changed:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:16:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-feaace54-6277-4c30-b8f1-485498e73a90 req-99ced314-3d08-44b0-90f6-a0f949cb8256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Apr 14 12:16:01 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 269/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] Creating event network-vif-plugged:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:16:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-3786a183-bb4a-4d06-b763-709b1fd8739d req-3adb069f-1d7e-49f7-a3ee-bdb6873f2b94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045507 Apr 14 12:16:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 270/811] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=12 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=12 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] Creating event network-vif-plugged:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:16:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-c5595c0b-7915-4137-b8db-fb19fa3307e3 req-7e24d8d1-9173-4613-ae63-63a5e89c42d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046206 Apr 14 12:16:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 273/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=20 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=30 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:11 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:11 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-77f42e6f-97d4-46a4-8100-7526b3b57053 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049439 Apr 14 12:16:11 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 270/813] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:16:11 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] Creating event network-changed:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:16:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b56652db-3b05-4b8b-b521-ff2acc5222ff req-94dcbffa-9616-4fcf-9efe-867e3492e07c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051903 Apr 14 12:16:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 271/814] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2127b0c3-3dc0-41d9-85cd-e8b4047ca326 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 200 len: 1539 microversion: 2.1 time: 0.187605 Apr 14 12:16:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 274/815] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:16:35 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:35 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:16:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ded41071-2b07-4068-956e-04166bb2d5ba tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 204 len: 0 microversion: 2.1 time: 0.196737 Apr 14 12:16:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:16:35 2023] DELETE /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:36 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e6f51853194dd7931111ff84ea10fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f89371d6c614961849733631ca6be66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-97f26ccc-0f59-4a34-9937-1a7d6b99046a tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 200 len: 1573 microversion: 2.1 time: 0.394353 Apr 14 12:16:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:16:35 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 1573 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "name": "network-vif-unplugged", "status": "completed", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] Creating event network-vif-unplugged:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:16:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2cddce20-53f1-41b2-ada8-98eced6e36c3 req-8c3969b1-468c-4d87-a48e-0db8603d21e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038953 Apr 14 12:16:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 275/818] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "name": "network-vif-deleted", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] Creating event network-vif-deleted:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:16:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-ba9ad164-bca6-4045-b81f-60ac1b93c190 req-c138a2c0-aeaf-4c82-a903-a6991487508f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 Apr 14 12:16:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 272/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e502a-7b98-4a46-ae3d-82339fbf07ca", "name": "network-vif-plugged", "status": "completed", "tag": "d1f86382-dd60-47d2-afae-5bbfd54c7489"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] Creating event network-vif-plugged:d1f86382-dd60-47d2-afae-5bbfd54c7489 for instance a83e502a-7b98-4a46-ae3d-82339fbf07ca on user Apr 14 12:16:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-a18ef68c-828d-44f0-944c-0bf3a19bae1c req-e8e7ed30-6991-453d-9114-e8b58af50e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029114 Apr 14 12:16:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 545be51c-649c-4297-a924-bbb6ecf303dd] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HTTP exception thrown: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Request method failure captured: Apr 14 12:16:39 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd HTTP/1.1 Apr 14 12:16:39 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:16:39 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:16:39 user devstack@n-api.service[61699]: Connection: close Apr 14 12:16:39 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:16:39 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:16:39 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:16:39 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:16:39 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-L6xGRXms-rc9ZUoOq_CJ40JB4-RIfEv30k8Q-N93ZkIFVrg0BrMKHIBa8D1agzzBShAkZk0tqqVBUWB4XZX7jtwUUvXl9HEeo0rII7h-Yc3pXLUMuszlUxa_zUjKpJtsOyMaNvRM_zXTFaNqtJ3J707HMIHUJAyg6pkzqLM0eLDs Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Project-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c5140d4419e43be941c2ac5d5439e35"}]}] Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Tenant-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:16:39 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:16:39 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:16:39 user devstack@n-api.service[61699]: X-User-Id: 11df88c60e4b456691d8731fe8facf38 Apr 14 12:16:39 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:16:39 user devstack@n-api.service[61699]: method: > Apr 14 12:16:39 user devstack@n-api.service[61699]: exception: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. Apr 14 12:16:39 user devstack@n-api.service[61699]: action_args: {'id': '545be51c-649c-4297-a924-bbb6ecf303dd'} Apr 14 12:16:39 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. Apr 14 12:16:39 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Returning 404 to user: Instance 545be51c-649c-4297-a924-bbb6ecf303dd could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:16:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e782297e-2389-4ccb-87f4-8f6262f1476c tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd" status: 404 len: 111 microversion: 2.87 time: 0.031657 Apr 14 12:16:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 276/821] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:16:39 2023] GET /compute/v2.1/servers/545be51c-649c-4297-a924-bbb6ecf303dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:16:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-43388693-3efa-4d1f-9ba8-dd1418e47532 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 204 len: 0 microversion: 2.87 time: 0.115501 Apr 14 12:16:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 273/822] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:16:39 2023] DELETE /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-unplugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:39 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] Creating event network-vif-unplugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:16:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-33e90a0a-d441-47b1-8149-f50841310c7a tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 200 len: 1775 microversion: 2.87 time: 0.286386 Apr 14 12:16:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 274/823] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:16:39 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 1775 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:16:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-e2a05625-1f3e-4acd-9c9b-8d5c29d08b9a req-4219236b-59e1-41a1-8a6b-d789163186b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033653 Apr 14 12:16:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 277/824] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1014012685", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] validate_networks() for [('42f6438c-9c79-4fe5-875b-1b5b5b9b0dda', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting quotas for project 930c6e3aceb3445c8bed09847c92f271. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Getting quotas for user f4063336b73e44ed991ca650d60bb3cd and project 930c6e3aceb3445c8bed09847c92f271. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:16:40 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:16:40 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5c0a2049-ede3-4402-9e5e-c0ca6c04fcde tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.705639 Apr 14 12:16:40 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 274/825] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:16:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:16:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bbad6302-4b1d-46d6-9a2b-892c8942e01e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:40 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bbad6302-4b1d-46d6-9a2b-892c8942e01e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:40 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-bbad6302-4b1d-46d6-9a2b-892c8942e01e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bbad6302-4b1d-46d6-9a2b-892c8942e01e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 200 len: 1211 microversion: 2.1 time: 0.074906 Apr 14 12:16:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:16:40 2023] GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 1211 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:41 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-plugged", "status": "completed", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}, {"server_uuid": "fcd74f51-099e-4c19-af7d-912f622fb153", "name": "network-vif-deleted", "tag": "a7084b3b-06c3-4e07-99fd-a37260b37f29"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Creating event network-vif-plugged:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:16:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] Creating event network-vif-deleted:a7084b3b-06c3-4e07-99fd-a37260b37f29 for instance fcd74f51-099e-4c19-af7d-912f622fb153 on user Apr 14 12:16:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ad856f58-ee39-41ff-8110-2b3032386a70 req-34c03076-8d95-48e7-b9c3-a25e9975a236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028560 Apr 14 12:16:41 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 278/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:43 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:43 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:43 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] Creating event network-changed:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:16:43 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0febe3be-6a47-4835-9f79-a29208aa32e7 req-e6bbb537-cd2b-4126-80c7-f5e41bca2b60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028336 Apr 14 12:16:43 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 275/828] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:45 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "name": "network-vif-plugged", "status": "completed", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] Creating event network-vif-plugged:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:16:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-8ee118f8-b908-4e89-bf9f-28201e374cd6 req-f8e6ea30-8495-44cd-9651-468a276dd219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029078 Apr 14 12:16:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 276/829] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "name": "network-vif-plugged", "status": "completed", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] Creating event network-vif-plugged:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:16:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-fd26266e-348b-4b8f-8187-3970d8191b75 req-e0be9e78-a002-4049-ad7b-20dc800dbb43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031232 Apr 14 12:16:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 279/830] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:48 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8e92931a-2fb1-4f54-a905-d9ec16ea9bc7 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 200 len: 1438 microversion: 2.1 time: 0.141728 Apr 14 12:16:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:16:48 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:54 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'services' on Instance uuid 9741284c-15ce-41e3-934d-bf8f46a407f5 {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:16:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-87091248-ea90-49c7-9d69-9845d5efeb6d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments/7daf6afe-aa4a-41fd-a6fd-2594e88abfdb" status: 202 len: 0 microversion: 2.1 time: 0.286684 Apr 14 12:16:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 277/832] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:16:54 2023] DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments/7daf6afe-aa4a-41fd-a6fd-2594e88abfdb => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:16:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:57 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Going to try to stop instance {{(pid=61699) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 12:16:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f84f7561-9bd7-477f-8384-819b7779f2b6 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action" status: 202 len: 0 microversion: 2.1 time: 0.110443 Apr 14 12:16:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 280/833] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:16:57 2023] POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:57 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:16:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-81e84da4-ff0f-483d-a91a-adc81950436a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1666 microversion: 2.1 time: 0.227435 Apr 14 12:16:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:16:57 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1666 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:16:57 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-unplugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:57 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] Creating event network-vif-unplugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:16:57 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b93aa42a-d79e-4de1-a4a2-83b064b5ae44 req-f5f726c7-0f8f-4d5f-acad-b3054b7e5cc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035296 Apr 14 12:16:57 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 278/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:16:59 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:16:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:16:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:16:59 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:16:59 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:16:59 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7a903f6d-90c7-44a6-a0c1-167d3feec835 req-267978b2-80b8-4bb5-961c-a653812788a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029047 Apr 14 12:16:59 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 281/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] [instance: a83e502a-7b98-4a46-ae3d-82339fbf07ca] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] HTTP exception thrown: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Request method failure captured: Apr 14 12:17:26 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca HTTP/1.1 Apr 14 12:17:26 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:17:26 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:17:26 user devstack@n-api.service[61701]: Connection: close Apr 14 12:17:26 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:17:26 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:17:26 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:17:26 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:17:26 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUKL2MZa4M4SvGaw4TK_Fb4CwpIp8wkeuO513g4zWDC7RASXxUHdPuxCG6VRD3O_ZOrGNKQhoheBBndBnQd2EseU8HuVZjvfcFV9E8GoQCe8g843bDDyt32p3NC9DMc5xXvGXNIkJ1vfg0iy6rHL1mIpiskw8Bb-tBijT9mBDnaOUi4 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Project-Id: 4f89371d6c614961849733631ca6be66 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Project-Name: tempest-SnapshotDataIntegrityTests-785189652 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f89371d6c614961849733631ca6be66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f89371d6c614961849733631ca6be66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f89371d6c614961849733631ca6be66"}]}] Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Tenant: tempest-SnapshotDataIntegrityTests-785189652 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Tenant-Id: 4f89371d6c614961849733631ca6be66 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-785189652 Apr 14 12:17:26 user devstack@n-api.service[61701]: X-User: tempest-SnapshotDataIntegrityTests-785189652-project-member Apr 14 12:17:26 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:17:26 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:17:26 user devstack@n-api.service[61701]: X-User-Id: f4e6f51853194dd7931111ff84ea10fb Apr 14 12:17:26 user devstack@n-api.service[61701]: X-User-Name: tempest-SnapshotDataIntegrityTests-785189652-project-member Apr 14 12:17:26 user devstack@n-api.service[61701]: method: > Apr 14 12:17:26 user devstack@n-api.service[61701]: exception: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. Apr 14 12:17:26 user devstack@n-api.service[61701]: action_args: {'id': 'a83e502a-7b98-4a46-ae3d-82339fbf07ca'} Apr 14 12:17:26 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. Apr 14 12:17:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:17:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Returning 404 to user: Instance a83e502a-7b98-4a46-ae3d-82339fbf07ca could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:17:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-38d6bcf2-b8d6-436d-9e2a-dc02bc5ba524 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca" status: 404 len: 111 microversion: 2.1 time: 0.035607 Apr 14 12:17:26 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 278/837] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:26 2023] GET /compute/v2.1/servers/a83e502a-7b98-4a46-ae3d-82339fbf07ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:17:26 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=20 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:26 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5c591c06-fddc-428c-8f4e-765bcd0b6720 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] Calling method '.version_select at 0x7f437177ecb0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5c591c06-fddc-428c-8f4e-765bcd0b6720 tempest-SnapshotDataIntegrityTests-785189652 tempest-SnapshotDataIntegrityTests-785189652-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1808636935" status: 202 len: 0 microversion: 2.1 time: 0.029229 Apr 14 12:17:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 279/838] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 12:17:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1808636935 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=16 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: fcd74f51-099e-4c19-af7d-912f622fb153] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HTTP exception thrown: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Request method failure captured: Apr 14 12:17:29 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 HTTP/1.1 Apr 14 12:17:29 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:17:29 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:17:29 user devstack@n-api.service[61699]: Connection: close Apr 14 12:17:29 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:17:29 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:17:29 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:17:29 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:17:29 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-L6xGRXms-rc9ZUoOq_CJ40JB4-RIfEv30k8Q-N93ZkIFVrg0BrMKHIBa8D1agzzBShAkZk0tqqVBUWB4XZX7jtwUUvXl9HEeo0rII7h-Yc3pXLUMuszlUxa_zUjKpJtsOyMaNvRM_zXTFaNqtJ3J707HMIHUJAyg6pkzqLM0eLDs Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Project-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c5140d4419e43be941c2ac5d5439e35"}]}] Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Tenant-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:17:29 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:17:29 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:17:29 user devstack@n-api.service[61699]: X-User-Id: 11df88c60e4b456691d8731fe8facf38 Apr 14 12:17:29 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:17:29 user devstack@n-api.service[61699]: method: > Apr 14 12:17:29 user devstack@n-api.service[61699]: exception: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. Apr 14 12:17:29 user devstack@n-api.service[61699]: action_args: {'id': 'fcd74f51-099e-4c19-af7d-912f622fb153'} Apr 14 12:17:29 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. Apr 14 12:17:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:17:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Returning 404 to user: Instance fcd74f51-099e-4c19-af7d-912f622fb153 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:17:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7a75a4f0-83a7-4fa8-a48f-cd2591f6d6b5 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153" status: 404 len: 111 microversion: 2.87 time: 0.048092 Apr 14 12:17:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 282/839] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:17:29 2023] GET /compute/v2.1/servers/fcd74f51-099e-4c19-af7d-912f622fb153 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:17:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d5867eef-8f54-418a-bad7-84503408bd9f tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 204 len: 0 microversion: 2.87 time: 0.145199 Apr 14 12:17:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 279/840] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 12:17:29 2023] DELETE /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "name": "network-vif-unplugged", "status": "completed", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] Creating event network-vif-unplugged:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 12:17:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-fde85270-4788-4a63-9a3c-61405e0718d5 req-02f14001-f115-4267-9aed-e290c58c2b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033876 Apr 14 12:17:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 283/841] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:30 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11df88c60e4b456691d8731fe8facf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5140d4419e43be941c2ac5d5439e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-30e78bd6-a36a-4ffc-91fa-ab46ae5f3dc2 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 200 len: 1697 microversion: 2.87 time: 0.380176 Apr 14 12:17:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 280/842] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:17:30 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 1697 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:31 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-52553e85-94b4-4c98-9bc0-44f9473b9035 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 200 len: 1493 microversion: 2.1 time: 0.260857 Apr 14 12:17:31 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 280/843] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:30 2023] GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 1493 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:17:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "name": "network-vif-plugged", "status": "completed", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}, {"server_uuid": "3a308eef-321e-45c9-bc63-f99c4eacef85", "name": "network-vif-deleted", "tag": "b417bb86-4450-4242-b710-0a5dd06d6777"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Creating event network-vif-plugged:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 12:17:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] Creating event network-vif-deleted:b417bb86-4450-4242-b710-0a5dd06d6777 for instance 3a308eef-321e-45c9-bc63-f99c4eacef85 on user Apr 14 12:17:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-ee97426f-ead7-40a4-b666-10362c177572 req-b979d137-f550-4e5b-913a-629157a66615 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029468 Apr 14 12:17:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 284/844] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-629daa07-7bfd-47fd-a75e-4b0156704b16 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.398976 Apr 14 12:17:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 281/845] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:17:35 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654/os-interface => generated 282 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] Creating event network-changed:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:17:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0a6724ae-cd3d-403e-8595-8f8a05d65d68 req-2c66b998-cc17-4b6e-a5e6-cac442de4665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Apr 14 12:17:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 281/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-770192826", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "12b17cd5-254d-41fb-b300-9968f8c873ec"}], "security_groups": [{"name": "tempest-securitygroup--1391015000"}], "key_name": "tempest-keypair-2086314618", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9c761194-9415-479b-82d2-23b11346cb28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:40 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] validate_networks() for [('12b17cd5-254d-41fb-b300-9968f8c873ec', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:17:41 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c761194-9415-479b-82d2-23b11346cb28',volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:17:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ddcb40aa-4b71-4d1d-82e7-f6a1bb7a33ce tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.833819 Apr 14 12:17:41 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 285/847] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:17:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:17:41 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cb2f91f2-e036-46d1-baad-fc263451e352 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:41 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cb2f91f2-e036-46d1-baad-fc263451e352 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:41 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-cb2f91f2-e036-46d1-baad-fc263451e352 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:41 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-cb2f91f2-e036-46d1-baad-fc263451e352 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1075 microversion: 2.1 time: 0.086416 Apr 14 12:17:41 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 282/848] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:41 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1075 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:17:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] Creating event network-changed:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:17:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-9f156527-ea10-41e8-8d74-43e4dc00aac2 req-d065ddd2-e888-44ac-8aac-0ec574b43cb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053664 Apr 14 12:17:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 282/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:47 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-323f2037-8844-4c6d-8eb2-ab05640d91ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1643 microversion: 2.1 time: 0.162449 Apr 14 12:17:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 286/850] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:47 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1643 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:49 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:49 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8aa819f5-8989-49c0-9533-02be3a34a0aa tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 200 len: 1438 microversion: 2.1 time: 0.320394 Apr 14 12:17:49 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 283/851] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:49 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 1438 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:17:50 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:17:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-046c495d-28a7-4cf6-8195-979c138f8368 req-2198255e-0396-4d45-a448-a047909e61ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029384 Apr 14 12:17:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 283/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:51 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:17:51 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-566431fe-e4ed-4e82-bb01-675283237c68 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 204 len: 0 microversion: 2.1 time: 0.298775 Apr 14 12:17:51 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 287/853] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:17:51 2023] DELETE /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:51 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:17:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-6e130ffb-6ee3-4f80-918b-e23f844e3b83 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 200 len: 1444 microversion: 2.1 time: 0.235673 Apr 14 12:17:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 284/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:17:51 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:17:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] Creating event network-vif-unplugged:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:17:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-d431ab2e-83a0-4d0e-bcb1-1c55b5fbcaf8 req-e1bdde9a-43e6-44c9-ba27-0958c8dfb243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087773 Apr 14 12:17:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 284/855] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}, {"name": "network-changed", "server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:17:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] Creating event network-changed:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:17:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-848cf93c-5fed-41f6-9728-c951e34274c4 req-4aee6f99-6d2b-4b88-98d7-dcea2a02ecc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043112 Apr 14 12:17:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 288/856] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:17:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "name": "network-vif-plugged", "status": "completed", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] Creating event network-vif-plugged:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:17:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-703c424b-f9f4-49ae-a667-896d9c8fead4 req-8453f5df-0c98-4fa0-8901-f878607b8012 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048277 Apr 14 12:17:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 285/857] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:17:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6f277a-7fde-43db-81be-ed9aaab827db", "name": "network-vif-deleted", "tag": "d8cc6c06-b720-46c2-8074-a5dc8c7f743a"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:17:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:17:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:17:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:17:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] Creating event network-vif-deleted:d8cc6c06-b720-46c2-8074-a5dc8c7f743a for instance 8b6f277a-7fde-43db-81be-ed9aaab827db on user Apr 14 12:17:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-8d15a1fc-802b-44c0-80e2-e303db2b7246 req-aac125b8-276e-42ee-98d1-5dfeb902a302 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 Apr 14 12:17:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 285/858] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] [instance: 3a308eef-321e-45c9-bc63-f99c4eacef85] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] HTTP exception thrown: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Request method failure captured: Apr 14 12:18:20 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 HTTP/1.1 Apr 14 12:18:20 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:18:20 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:18:20 user devstack@n-api.service[61699]: Connection: close Apr 14 12:18:20 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:18:20 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:18:20 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:18:20 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:18:20 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOT-L6xGRXms-rc9ZUoOq_CJ40JB4-RIfEv30k8Q-N93ZkIFVrg0BrMKHIBa8D1agzzBShAkZk0tqqVBUWB4XZX7jtwUUvXl9HEeo0rII7h-Yc3pXLUMuszlUxa_zUjKpJtsOyMaNvRM_zXTFaNqtJ3J707HMIHUJAyg6pkzqLM0eLDs Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Project-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c5140d4419e43be941c2ac5d5439e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c5140d4419e43be941c2ac5d5439e35"}]}] Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Tenant-Id: 2c5140d4419e43be941c2ac5d5439e35 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:18:20 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:18:20 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:18:20 user devstack@n-api.service[61699]: X-User-Id: 11df88c60e4b456691d8731fe8facf38 Apr 14 12:18:20 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member Apr 14 12:18:20 user devstack@n-api.service[61699]: method: > Apr 14 12:18:20 user devstack@n-api.service[61699]: exception: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. Apr 14 12:18:20 user devstack@n-api.service[61699]: action_args: {'id': '3a308eef-321e-45c9-bc63-f99c4eacef85'} Apr 14 12:18:20 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. Apr 14 12:18:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] Returning 404 to user: Instance 3a308eef-321e-45c9-bc63-f99c4eacef85 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-21fa0e9e-f090-4ac4-807d-582c0af48c17 tempest-ServerBootFromVolumeStableRescueTest-1565599676 tempest-ServerBootFromVolumeStableRescueTest-1565599676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85" status: 404 len: 111 microversion: 2.87 time: 0.037574 Apr 14 12:18:20 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 289/859] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 12:18:20 2023] GET /compute/v2.1/servers/3a308eef-321e-45c9-bc63-f99c4eacef85 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:18:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=14 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:24 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b86e6d98-2e27-474c-b6c7-57a2b0061d25 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Action: 'create', calling method: .version_select at 0x7f43719cbeb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-923602178"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b86e6d98-2e27-474c-b6c7-57a2b0061d25 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.541026 Apr 14 12:18:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 286/860] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 12:18:24 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 543 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 12:18:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9ea55bac-c0bb-47b9-80ab-c5b31737470a tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f437176a560>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9ea55bac-c0bb-47b9-80ab-c5b31737470a tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 344 microversion: 2.1 time: 0.060850 Apr 14 12:18:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 286/861] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:25 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:26 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-15c85b62-5b25-4819-8d2a-eb1a4396ca93 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717bd000>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-15c85b62-5b25-4819-8d2a-eb1a4396ca93 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 344 microversion: 2.1 time: 0.057586 Apr 14 12:18:26 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 290/862] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:26 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f19824c3-819c-42ea-ae64-dbec17211daf tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43718fb6d0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f19824c3-819c-42ea-ae64-dbec17211daf tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 345 microversion: 2.1 time: 0.051980 Apr 14 12:18:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 287/863] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:27 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-b4c22bc7-22a6-4e79-a673-994559a4fce3 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Action: 'create', calling method: .version_select at 0x7f4371872d40>, body: {"snapshot": {"volume_id": "31b8ef54-861b-4a62-ba10-4d1d244201b7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1841138188"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-b4c22bc7-22a6-4e79-a673-994559a4fce3 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160718 Apr 14 12:18:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 287/864] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 12:18:27 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-04f309cb-1799-4c12-82de-d5fd1d7f477e tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717ed360>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-04f309cb-1799-4c12-82de-d5fd1d7f477e tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.034313 Apr 14 12:18:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 291/865] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:27 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0a31c2de-e2a2-4566-8615-1a42876c562c tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43718f8f70>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0a31c2de-e2a2-4566-8615-1a42876c562c tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037435 Apr 14 12:18:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 288/866] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 12:18:27 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:27 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d27a1494-82c4-4257-9cb8-556ac3a5448a tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f4371829990>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:27 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d27a1494-82c4-4257-9cb8-556ac3a5448a tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.035660 Apr 14 12:18:27 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 288/867] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:27 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d0685894-85a1-4051-b2b6-decd1e50df15 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717bcd30>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d0685894-85a1-4051-b2b6-decd1e50df15 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.035980 Apr 14 12:18:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 292/868] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:28 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-49090000-8ee8-4481-9408-08220ac0d6d3 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43719ca7a0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-49090000-8ee8-4481-9408-08220ac0d6d3 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 288 microversion: 2.1 time: 0.037260 Apr 14 12:18:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 289/869] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:29 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5a40221c-6f4a-45b1-b86f-0fb7a0146d61 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f437160af80>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5a40221c-6f4a-45b1-b86f-0fb7a0146d61 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 202 len: 0 microversion: 2.1 time: 0.068588 Apr 14 12:18:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 289/870] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 12:18:29 2023] DELETE /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:18:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-37c15d4a-d7bc-44a0-815a-b31fc01903b1 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717bf400>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-37c15d4a-d7bc-44a0-815a-b31fc01903b1 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.036425 Apr 14 12:18:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 293/871] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:29 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-076b1558-3a4e-4ce9-847b-c0a549ee9ef0 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43719ca440>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-076b1558-3a4e-4ce9-847b-c0a549ee9ef0 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.077308 Apr 14 12:18:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 290/872] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:30 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:31 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:18:31 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-02becc6b-9666-47d4-8bdb-895823601924 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 204 len: 0 microversion: 2.1 time: 0.117010 Apr 14 12:18:31 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 290/873] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:18:31 2023] DELETE /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-741bf4e0-f6f6-49ba-8d73-50bf6d0de92d tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f4371b18dc0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-741bf4e0-f6f6-49ba-8d73-50bf6d0de92d tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 200 len: 287 microversion: 2.1 time: 0.045111 Apr 14 12:18:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 291/874] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:32 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:32 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:18:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-96103548-7c13-4e91-9334-e44f5ce5715e tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 200 len: 1499 microversion: 2.1 time: 0.656347 Apr 14 12:18:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 294/875] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:31 2023] GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 1499 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:18:32 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:18:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-658d0153-9fbb-4ba9-a6d6-5bbf36daf7c4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1427 microversion: 2.1 time: 0.874108 Apr 14 12:18:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 291/876] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:31 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1427 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:18:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] Creating event network-vif-unplugged:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:18:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-0a214f04-ae4a-40d1-b2c3-cde76496a097 req-47ffb6d9-0f8f-4c5c-8234-aa647eed21d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029281 Apr 14 12:18:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 292/877] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "name": "network-vif-deleted", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] Creating event network-vif-deleted:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:18:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b6410ffb-b8d2-43c6-99fa-f9068c8bb1bf req-1030eec7-d653-4e8d-814d-c7139c11dcc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083825 Apr 14 12:18:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 295/878] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9ec8dda8-8c12-46ef-a4e9-ca03cbf01a42 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43718f9510>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:33 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-9ec8dda8-8c12-46ef-a4e9-ca03cbf01a42 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] HTTP exception thrown: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. Apr 14 12:18:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9ec8dda8-8c12-46ef-a4e9-ca03cbf01a42 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Request method failure captured: Apr 14 12:18:33 user devstack@n-api.service[61700]: request: GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a HTTP/1.1 Apr 14 12:18:33 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:18:33 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:18:33 user devstack@n-api.service[61700]: Connection: close Apr 14 12:18:33 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:18:33 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:18:33 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:18:33 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:18:33 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUSQkFMLbP7HkT6MVrpALiZ6vWKqJzeRNv1ZwejUJELLRV3ZY5zJBhlksQHpj3Zx6mSDY6GYGvj-ou_wGpzIYmmO1YiHRYPF7lht-ocYh6yjsTAmL74sqIoH9a7FEYHAuKtjgAKgElHXRA2T0m9UjyGLjC6ZeBd5OWa27Lf1nG7IOMU Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Project-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/696da5e030ce49789ab6d50898e9c53c"}]}] Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Tenant-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:33 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:33 user devstack@n-api.service[61700]: X-User: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:33 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:18:33 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:18:33 user devstack@n-api.service[61700]: X-User-Id: fa2397d2efc9421aa00b69bf527d5c2a Apr 14 12:18:33 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:33 user devstack@n-api.service[61700]: method: Apr 14 12:18:33 user devstack@n-api.service[61700]: exception: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. Apr 14 12:18:33 user devstack@n-api.service[61700]: action_args: {'id': 'd4cc5216-240a-4a3e-a1ef-5353d950228a'} Apr 14 12:18:33 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. (HTTP 404) (Request-ID: req-58d23a00-f159-4d42-9bef-5a752cb2b8cc) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. Apr 14 12:18:33 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-9ec8dda8-8c12-46ef-a4e9-ca03cbf01a42 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Returning 404 to user: Snapshot d4cc5216-240a-4a3e-a1ef-5353d950228a could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:33 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-9ec8dda8-8c12-46ef-a4e9-ca03cbf01a42 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a" status: 404 len: 111 microversion: 2.1 time: 0.039695 Apr 14 12:18:33 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 292/879] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 12:18:33 2023] GET /compute/v2.1/os-snapshots/d4cc5216-240a-4a3e-a1ef-5353d950228a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:18:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-1f2dc7f3-b08f-4b2a-93c8-7b5a048aae69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f4371608940>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-1f2dc7f3-b08f-4b2a-93c8-7b5a048aae69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 202 len: 0 microversion: 2.1 time: 0.102179 Apr 14 12:18:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 293/880] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:18:33 2023] DELETE /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:18:33 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-bcf31bdf-331d-4e94-aec8-181df51d8121 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717bc790>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-bcf31bdf-331d-4e94-aec8-181df51d8121 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 344 microversion: 2.1 time: 0.058251 Apr 14 12:18:33 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 296/881] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:33 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-90965b2e-633b-46b0-8f14-feb7c3fe0591 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43719c8e50>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-90965b2e-633b-46b0-8f14-feb7c3fe0591 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 344 microversion: 2.1 time: 0.097877 Apr 14 12:18:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 293/882] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:34 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92742ea2-11c2-4701-aafc-4b49787881a4", "name": "network-vif-plugged", "status": "completed", "tag": "2e478563-f11d-413c-8fba-e54ce2abb7ff"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] Creating event network-vif-plugged:2e478563-f11d-413c-8fba-e54ce2abb7ff for instance 92742ea2-11c2-4701-aafc-4b49787881a4 on user Apr 14 12:18:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-634ded91-7e15-47fd-a05f-0a01e5442fe5 req-c6983e9a-3ec9-4628-b33c-b54b5647deed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039001 Apr 14 12:18:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 294/883] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7a1860cf-1042-4a64-a073-68abbebe5d05 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717ec310>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7a1860cf-1042-4a64-a073-68abbebe5d05 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 200 len: 344 microversion: 2.1 time: 0.060247 Apr 14 12:18:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 297/884] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:35 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eaf396bd-7280-45d6-beab-1ae0811b7367 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43718f8700>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-eaf396bd-7280-45d6-beab-1ae0811b7367 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] HTTP exception thrown: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eaf396bd-7280-45d6-beab-1ae0811b7367 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Request method failure captured: Apr 14 12:18:36 user devstack@n-api.service[61700]: request: GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 HTTP/1.1 Apr 14 12:18:36 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:18:36 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:18:36 user devstack@n-api.service[61700]: Connection: close Apr 14 12:18:36 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:18:36 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:18:36 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:18:36 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:18:36 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUSQkFMLbP7HkT6MVrpALiZ6vWKqJzeRNv1ZwejUJELLRV3ZY5zJBhlksQHpj3Zx6mSDY6GYGvj-ou_wGpzIYmmO1YiHRYPF7lht-ocYh6yjsTAmL74sqIoH9a7FEYHAuKtjgAKgElHXRA2T0m9UjyGLjC6ZeBd5OWa27Lf1nG7IOMU Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Project-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/696da5e030ce49789ab6d50898e9c53c"}]}] Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Tenant-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61700]: X-User: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61700]: X-User-Id: fa2397d2efc9421aa00b69bf527d5c2a Apr 14 12:18:36 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61700]: method: Apr 14 12:18:36 user devstack@n-api.service[61700]: exception: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61700]: action_args: {'id': '31b8ef54-861b-4a62-ba10-4d1d244201b7'} Apr 14 12:18:36 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. (HTTP 404) (Request-ID: req-2abcf193-62e6-4549-9446-0435aa61aa7b) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eaf396bd-7280-45d6-beab-1ae0811b7367 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Returning 404 to user: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-eaf396bd-7280-45d6-beab-1ae0811b7367 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 404 len: 109 microversion: 2.1 time: 0.039357 Apr 14 12:18:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 294/885] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:36 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:18:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4e412a56-b60f-4a9a-b62c-e3f838e30bca tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f4371b19ab0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-4e412a56-b60f-4a9a-b62c-e3f838e30bca tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] HTTP exception thrown: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4e412a56-b60f-4a9a-b62c-e3f838e30bca tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Request method failure captured: Apr 14 12:18:36 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 HTTP/1.1 Apr 14 12:18:36 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:18:36 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:18:36 user devstack@n-api.service[61701]: Connection: close Apr 14 12:18:36 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:18:36 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:18:36 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:18:36 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:18:36 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUSQkFMLbP7HkT6MVrpALiZ6vWKqJzeRNv1ZwejUJELLRV3ZY5zJBhlksQHpj3Zx6mSDY6GYGvj-ou_wGpzIYmmO1YiHRYPF7lht-ocYh6yjsTAmL74sqIoH9a7FEYHAuKtjgAKgElHXRA2T0m9UjyGLjC6ZeBd5OWa27Lf1nG7IOMU Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Project-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/696da5e030ce49789ab6d50898e9c53c"}]}] Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Tenant-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61701]: X-User: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61701]: X-User-Id: fa2397d2efc9421aa00b69bf527d5c2a Apr 14 12:18:36 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61701]: method: Apr 14 12:18:36 user devstack@n-api.service[61701]: exception: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61701]: action_args: {'id': '31b8ef54-861b-4a62-ba10-4d1d244201b7'} Apr 14 12:18:36 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. (HTTP 404) (Request-ID: req-85a0b296-b1f6-4d1c-bdc9-0e9d6ceae52b) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4e412a56-b60f-4a9a-b62c-e3f838e30bca tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Returning 404 to user: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4e412a56-b60f-4a9a-b62c-e3f838e30bca tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 404 len: 109 microversion: 2.1 time: 0.047422 Apr 14 12:18:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 295/886] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:18:36 2023] DELETE /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:18:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0d5938eb-4e6c-4c40-9cc5-22da1b8eed69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Calling method '.version_select at 0x7f43717ee8c0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-0d5938eb-4e6c-4c40-9cc5-22da1b8eed69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] HTTP exception thrown: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0d5938eb-4e6c-4c40-9cc5-22da1b8eed69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Request method failure captured: Apr 14 12:18:36 user devstack@n-api.service[61699]: request: GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 HTTP/1.1 Apr 14 12:18:36 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:18:36 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:18:36 user devstack@n-api.service[61699]: Connection: close Apr 14 12:18:36 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:18:36 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:18:36 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:18:36 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:18:36 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUSQkFMLbP7HkT6MVrpALiZ6vWKqJzeRNv1ZwejUJELLRV3ZY5zJBhlksQHpj3Zx6mSDY6GYGvj-ou_wGpzIYmmO1YiHRYPF7lht-ocYh6yjsTAmL74sqIoH9a7FEYHAuKtjgAKgElHXRA2T0m9UjyGLjC6ZeBd5OWa27Lf1nG7IOMU Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Project-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/696da5e030ce49789ab6d50898e9c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/696da5e030ce49789ab6d50898e9c53c"}]}] Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Tenant-Id: 696da5e030ce49789ab6d50898e9c53c Apr 14 12:18:36 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1641334262 Apr 14 12:18:36 user devstack@n-api.service[61699]: X-User: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:18:36 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:18:36 user devstack@n-api.service[61699]: X-User-Id: fa2397d2efc9421aa00b69bf527d5c2a Apr 14 12:18:36 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1641334262-project-member Apr 14 12:18:36 user devstack@n-api.service[61699]: method: Apr 14 12:18:36 user devstack@n-api.service[61699]: exception: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61699]: action_args: {'id': '31b8ef54-861b-4a62-ba10-4d1d244201b7'} Apr 14 12:18:36 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. (HTTP 404) (Request-ID: req-7a4c3208-34a6-4ad5-804f-514191236530) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. Apr 14 12:18:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:18:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0d5938eb-4e6c-4c40-9cc5-22da1b8eed69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] Returning 404 to user: Volume 31b8ef54-861b-4a62-ba10-4d1d244201b7 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0d5938eb-4e6c-4c40-9cc5-22da1b8eed69 tempest-VolumesSnapshotsTestJSON-1641334262 tempest-VolumesSnapshotsTestJSON-1641334262-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7" status: 404 len: 109 microversion: 2.1 time: 0.037621 Apr 14 12:18:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 298/887] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 12:18:36 2023] GET /compute/v2.1/os-volumes/31b8ef54-861b-4a62-ba10-4d1d244201b7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:18:42 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db HTTP/1.1 Apr 14 12:18:42 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:18:42 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:18:42 user devstack@n-api.service[61700]: Connection: close Apr 14 12:18:42 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:18:42 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:18:42 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:18:42 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:18:42 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:18:42 user devstack@n-api.service[61700]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:18:42 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:18:42 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:18:42 user devstack@n-api.service[61700]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:18:42 user devstack@n-api.service[61700]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:18:42 user devstack@n-api.service[61700]: method: > Apr 14 12:18:42 user devstack@n-api.service[61700]: exception: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:18:42 user devstack@n-api.service[61700]: action_args: {'id': '8b6f277a-7fde-43db-81be-ed9aaab827db'} Apr 14 12:18:42 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:18:42 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:18:42 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:18:42 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8ae4ea50-1791-4e25-b788-ffad3c99df2e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 404 len: 111 microversion: 2.1 time: 0.045956 Apr 14 12:18:42 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 295/888] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:42 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1722857272", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-582531121", "security_groups": [{"name": "tempest-secgroup-smoke-388343603"}], "block_device_mapping_v2": [{"uuid": "e8c18af9-e524-4926-993c-10728f35875a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:18:42 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8c18af9-e524-4926-993c-10728f35875a',volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:18:42 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-572f3c01-0576-498f-bcdc-c702c65703ee tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.699358 Apr 14 12:18:42 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 296/889] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:18:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:18:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:42 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=10 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:42 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-23b4c6f1-13e4-45d4-be97-0af4e3e02cb8 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:42 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-23b4c6f1-13e4-45d4-be97-0af4e3e02cb8 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:43 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-23b4c6f1-13e4-45d4-be97-0af4e3e02cb8 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:18:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-23b4c6f1-13e4-45d4-be97-0af4e3e02cb8 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 200 len: 1089 microversion: 2.1 time: 0.077348 Apr 14 12:18:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:42 2023] GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:18:45 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:45 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] Creating event network-changed:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:18:45 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-b81e66a6-642a-4f2b-8490-4a4cfe245dbd req-39df8962-9a8b-424b-b4a5-548dc979ade3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029016 Apr 14 12:18:45 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 296/891] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Going to try to start instance {{(pid=61701) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 12:18:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2211165f-4739-42e5-b299-97147f1b8142 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action" status: 202 len: 0 microversion: 2.1 time: 0.079019 Apr 14 12:18:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 297/892] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:18:47 2023] POST /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:48 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:18:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-abf0cbdd-8002-43a7-87a1-eedfadbca6e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1652 microversion: 2.1 time: 0.146082 Apr 14 12:18:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 300/893] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:47 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:18:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:18:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-09cf07af-5859-423f-99a8-80004ae9413f req-7dc63703-37a8-464d-b1fa-1c97920ac516 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Apr 14 12:18:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 297/894] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:52 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "name": "network-vif-plugged", "status": "completed", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:52 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] Creating event network-vif-plugged:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:18:52 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e5a085e9-7cff-4941-83f3-17394273cb2b req-ff9c2936-8ea7-4506-82c1-25bd67516f18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045489 Apr 14 12:18:52 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 298/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:18:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-33149546-a73e-482f-9fff-de2457c48b5b req-c7c93d9d-7ccf-4f91-987c-e783e9698353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049674 Apr 14 12:18:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 301/896] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:54 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "name": "network-vif-plugged", "status": "completed", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:54 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:54 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=13 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] Creating event network-vif-plugged:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:18:54 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ff392b26-9a17-459e-8f40-657ad73b1da8 req-95bbf16e-fd90-424b-9ccd-e61fa8db0067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037566 Apr 14 12:18:54 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 298/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:18:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1643534439", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "61b8bcf7-3906-43bf-a28f-4b184513279c"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] validate_networks() for [('61b8bcf7-3906-43bf-a28f-4b184513279c', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting quotas for project 9743d731274a493488bbf9df3d65d073. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting quotas for user e05e233f8bc749289056606d7046b38d and project 9743d731274a493488bbf9df3d65d073. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:18:59 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:18:59 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-84c47f87-1cd0-4428-ba95-f3b99425dcac tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.525584 Apr 14 12:18:59 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 299/898] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:18:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:18:59 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:18:59 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-295d8aee-c8b0-4ac6-b038-93c763f0f299 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:18:59 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-295d8aee-c8b0-4ac6-b038-93c763f0f299 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:18:59 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-295d8aee-c8b0-4ac6-b038-93c763f0f299 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:18:59 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-295d8aee-c8b0-4ac6-b038-93c763f0f299 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a" status: 200 len: 1208 microversion: 2.1 time: 0.062073 Apr 14 12:18:59 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 302/899] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:18:59 2023] GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a => generated 1208 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:19:02 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:02 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] Creating event network-changed:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:19:02 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ff6b69c1-da56-48ef-a871-7ef500ca3b76 req-fcdc5727-1569-4273-8274-78445ebc0ec4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032338 Apr 14 12:19:02 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 299/900] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "name": "network-vif-plugged", "status": "completed", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:04 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] Creating event network-vif-plugged:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:19:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e0cd272d-81cb-458a-a994-039ad2f4b8b3 req-17721ca6-d013-40b4-b340-280fdd354fe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031527 Apr 14 12:19:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 300/901] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "name": "network-vif-plugged", "status": "completed", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] Creating event network-vif-plugged:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:19:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f135593f-de0b-4747-83ec-cacabefcf3dc req-5e987c55-df78-4b33-8fdd-de5b35b6c899 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043728 Apr 14 12:19:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] HTTP exception thrown: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:19:22 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 HTTP/1.1 Apr 14 12:19:22 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:19:22 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:19:22 user devstack@n-api.service[61700]: Connection: close Apr 14 12:19:22 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:19:22 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:19:22 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:19:22 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:19:22 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:19:22 user devstack@n-api.service[61700]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:19:22 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:19:22 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:19:22 user devstack@n-api.service[61700]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:19:22 user devstack@n-api.service[61700]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:19:22 user devstack@n-api.service[61700]: method: > Apr 14 12:19:22 user devstack@n-api.service[61700]: exception: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:19:22 user devstack@n-api.service[61700]: action_args: {'id': '92742ea2-11c2-4701-aafc-4b49787881a4'} Apr 14 12:19:22 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:19:22 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:19:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 404 to user: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:19:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-13eb3898-3c4d-42fb-93e9-06428f71d0d4 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 404 len: 111 microversion: 2.1 time: 0.038995 Apr 14 12:19:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 300/903] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:22 2023] GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:22 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-95223544-978c-4ac1-b00f-a7c39c30eca7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1492 microversion: 2.1 time: 0.159830 Apr 14 12:19:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 301/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:22 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=14 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-0297d37b-4e06-4750-9947-207f7960911b tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.105295 Apr 14 12:19:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 304/905] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:19:32 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:33 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c9c2f8d8-24fc-48c7-87bb-98702a6c0737 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 200 len: 1439 microversion: 2.1 time: 0.220447 Apr 14 12:19:33 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 301/906] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:33 2023] GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 1439 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] Creating event network-changed:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:19:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-8e707c51-6331-4c18-8f0b-84a2b9f73e3d req-b365499f-b61c-467a-aa86-e582fbdfca9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Apr 14 12:19:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 302/907] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:33 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-5e9b7b34-3b13-44bb-bc80-b3ce6138fa34 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1427 microversion: 2.1 time: 0.198099 Apr 14 12:19:33 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:33 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Old instance type m1.nano, new instance type m1.micro {{(pid=61700) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Getting quotas for user 7e264a59ff9b42e08095d0ce71e4d627 and project 3e4ff63247dd4535bcd86acfde76fd34. Resources: {'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:19:34 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:19:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c505fb26-2c6f-43c0-8287-880192b0e47d tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action" status: 202 len: 0 microversion: 2.1 time: 0.231126 Apr 14 12:19:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 302/909] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:19:33 2023] POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:34 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-48a93e12-0dae-4809-900d-6d0ff11c6410 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1436 microversion: 2.1 time: 0.300340 Apr 14 12:19:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 303/910] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:34 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1436 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:19:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Creating event network-changed:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:19:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:19:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2a25a065-ceb9-4bd5-830f-6e50e83554f0 req-82a93b15-05f5-4ec2-ab70-ba2f9f446b6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058820 Apr 14 12:19:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 306/911] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-unplugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Creating event network-vif-unplugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:19:37 user devstack@n-api.service[61700]: DEBUG nova.compute.api [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:19:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-0366eb07-634b-431b-a700-58441c412877 req-3e8a557e-4ad9-4939-a162-46171d6f58a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042537 Apr 14 12:19:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 303/912] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:38 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2674d85a-3c0f-4928-b880-6ca8ffe0fb52 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1656 microversion: 2.1 time: 0.156211 Apr 14 12:19:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 304/913] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:38 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:19:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:19:39 user devstack@n-api.service[61699]: DEBUG nova.compute.api [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:19:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-9c1f5319-7aef-4b56-82f6-e1c83798e1c6 req-f906ed4b-3b9b-4877-b43d-4082690fac32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037514 Apr 14 12:19:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 307/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=18 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:19:47 user devstack@n-api.service[61700]: DEBUG nova.compute.api [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:19:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-e0eb3fd1-13da-4e7c-bc56-2ba800582243 req-8e5ccbc0-22bf-44c2-a9b6-db2e54ea01c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041992 Apr 14 12:19:47 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 304/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=14 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:19:49 user devstack@n-api.service[61701]: DEBUG nova.compute.api [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 12:19:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-ff8632fe-4f1c-4347-922d-5cc41c201b6c req-8b0ca369-7d81-4ee8-bdcf-97fae79959f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042534 Apr 14 12:19:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 305/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=18 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:19:50 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:19:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9a23cc6b-4f3d-4709-8d66-dfacbe3cdc74 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a" status: 200 len: 1487 microversion: 2.1 time: 0.152767 Apr 14 12:19:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 308/917] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:19:50 2023] GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a => generated 1487 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:24 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-452b3108-d5d6-4dcd-91b5-da0d96898a1e tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1554 microversion: 2.1 time: 0.228909 Apr 14 12:20:24 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 305/918] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:24 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-757845c4-658d-414a-81f5-cbedfee5ebd1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-871779182", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8947056e-2023-49f6-b5d3-4a6c3cd2f4fc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-757845c4-658d-414a-81f5-cbedfee5ebd1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] HTTP exception thrown: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. Apr 14 12:20:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-757845c4-658d-414a-81f5-cbedfee5ebd1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:20:25 user devstack@n-api.service[61701]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 12:20:25 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:20:25 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:20:25 user devstack@n-api.service[61701]: Connection: close Apr 14 12:20:25 user devstack@n-api.service[61701]: Content-Length: 356 Apr 14 12:20:25 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:20:25 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:20:25 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:20:25 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:20:25 user devstack@n-api.service[61701]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:20:25 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:20:25 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:20:25 user devstack@n-api.service[61701]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:20:25 user devstack@n-api.service[61701]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:20:25 user devstack@n-api.service[61701]: Apr 14 12:20:25 user devstack@n-api.service[61701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-871779182", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8947056e-2023-49f6-b5d3-4a6c3cd2f4fc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} Apr 14 12:20:25 user devstack@n-api.service[61701]: method: > Apr 14 12:20:25 user devstack@n-api.service[61701]: exception: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. Apr 14 12:20:25 user devstack@n-api.service[61701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-871779182', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8947056e-2023-49f6-b5d3-4a6c3cd2f4fc'}], 'networks': [{'uuid': '42f6438c-9c79-4fe5-875b-1b5b5b9b0dda'}]}}} Apr 14 12:20:25 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. Apr 14 12:20:25 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:20:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-757845c4-658d-414a-81f5-cbedfee5ebd1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 400 to user: Block Device 8947056e-2023-49f6-b5d3-4a6c3cd2f4fc is not bootable. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:20:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-757845c4-658d-414a-81f5-cbedfee5ebd1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.079742 Apr 14 12:20:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 306/919] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:20:25 2023] POST /compute/v2.1/servers => generated 110 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:25 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:25 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1dc486e7-252a-4c8f-ad8d-4b5c6853ddcf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1492 microversion: 2.1 time: 0.147204 Apr 14 12:20:25 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 309/920] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:25 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1492 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:33 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:33 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ad02288c-2ed9-477f-b4a7-47cb0b501f72 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 200 len: 1439 microversion: 2.1 time: 0.155151 Apr 14 12:20:33 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:33 2023] GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 1439 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:35 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:35 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] Creating event network-changed:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:20:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-b48b1e1e-7884-40e7-904f-377b53b6477b req-8880a756-7e1d-4eed-b1f7-c02e1d01ba5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040764 Apr 14 12:20:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 307/922] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-18ac8aed-77f1-4343-bc27-e776b3b867e2 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046218 Apr 14 12:20:38 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 310/923] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:20:38 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:20:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-1f592508-477d-405f-8a77-6d07e85715b5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 204 len: 0 microversion: 2.1 time: 0.126402 Apr 14 12:20:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 307/924] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:20:38 2023] DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:38 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e5db4d7c-b1a1-4148-ae29-6fec9531313e tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 200 len: 1662 microversion: 2.1 time: 0.166779 Apr 14 12:20:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 308/925] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:38 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 1662 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-unplugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] Creating event network-vif-unplugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:20:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-610fea7c-1bc3-429d-a231-86df1aecfd9b req-c9d859da-e967-4035-85f6-78f57cf3cd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087608 Apr 14 12:20:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 311/926] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-deleted", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] Creating event network-vif-deleted:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:20:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-4136f0a9-35c8-4264-83ae-951a25a282f4 req-64628691-f335-4ad0-a2fa-09c64f7c2214 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045467 Apr 14 12:20:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 308/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741284c-15ce-41e3-934d-bf8f46a407f5", "name": "network-vif-plugged", "status": "completed", "tag": "884fdba5-501f-4614-9e53-3e4b96a90630"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] Creating event network-vif-plugged:884fdba5-501f-4614-9e53-3e4b96a90630 for instance 9741284c-15ce-41e3-934d-bf8f46a407f5 on user Apr 14 12:20:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-7d9234c6-647a-4c3f-b6e6-02ebec2b1d7c req-ffcbe928-1c3e-4dfc-bb9b-77808180aa48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038642 Apr 14 12:20:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 309/928] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1881127138", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-582531121", "security_groups": [{"name": "tempest-secgroup-smoke-388343603"}], "block_device_mapping_v2": [{"uuid": "0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "62954fef-bef3-483c-8311-33e968bc1180"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:43 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] validate_networks() for [('62954fef-bef3-483c-8311-33e968bc1180', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Getting quotas for user 511fd95d993e4837a4a612385b04fdcb and project 0c317cb8d6a44115b216678540c433b6. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:20:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a5e5b59-5450-4d62-8ce9-e4e24ebd8efa',volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:20:44 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-358dccd3-6c69-42d6-8c2c-fa93565da5f2 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.832137 Apr 14 12:20:44 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 312/929] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:20:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:20:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-638235db-3a57-48ab-a49a-d1fb7e62af7b tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-638235db-3a57-48ab-a49a-d1fb7e62af7b tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:44 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-638235db-3a57-48ab-a49a-d1fb7e62af7b tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-638235db-3a57-48ab-a49a-d1fb7e62af7b tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 200 len: 1089 microversion: 2.1 time: 0.067461 Apr 14 12:20:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 309/930] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:44 2023] GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] Creating event network-changed:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:20:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e1bb33eb-2d19-4743-8f79-e0496db57410 req-3a9420b2-3c7e-4de7-811e-686f0199643d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035386 Apr 14 12:20:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 310/931] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:20:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-77d7ec4c-1336-48a5-aa24-4eb34ee89357 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a" status: 204 len: 0 microversion: 2.1 time: 0.122657 Apr 14 12:20:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 313/932] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:20:50 2023] DELETE /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:51 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:20:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-271672c7-ba83-4657-b047-bfcd184cc067 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a" status: 200 len: 1493 microversion: 2.1 time: 0.208404 Apr 14 12:20:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 310/933] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:20:50 2023] GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:20:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "name": "network-vif-unplugged", "status": "completed", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] Creating event network-vif-unplugged:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:20:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-1ccc4c86-778d-450e-bd9b-813af61aab95 req-1366aa17-07f6-4d40-9383-182a00f1a54f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043637 Apr 14 12:20:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 311/934] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "name": "network-vif-deleted", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] Creating event network-vif-deleted:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:20:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-b463f2f5-6b4e-4aae-a074-4228f638e804 req-c819133e-0b39-4457-b620-45bbf2464f4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036439 Apr 14 12:20:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 314/935] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:53 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95db2830-1af3-49e6-af4b-bb8805db707a", "name": "network-vif-plugged", "status": "completed", "tag": "54a83467-5b88-4040-8edb-1bc984d9d179"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:53 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] Creating event network-vif-plugged:54a83467-5b88-4040-8edb-1bc984d9d179 for instance 95db2830-1af3-49e6-af4b-bb8805db707a on user Apr 14 12:20:53 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-0e5a681e-47f6-4246-8502-38b103915827 req-a6a6e1ad-3373-4252-bd18-d5a3d8d232ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037938 Apr 14 12:20:53 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 311/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:20:55 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "name": "network-vif-plugged", "status": "completed", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}, {"server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "name": "network-vif-plugged", "status": "completed", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:20:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:20:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:20:55 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:20:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Creating event network-vif-plugged:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:20:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] Creating event network-vif-plugged:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:20:55 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-cb1dfdb2-33b9-4edc-8dd6-4b68c8a60b6d req-53c7674d-b286-46ff-9f79-07d76a6d8b61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033630 Apr 14 12:20:55 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 312/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:24 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:24 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1ba0b002-c9c7-4813-b127-fdd406d7e381 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action" status: 204 len: 0 microversion: 2.1 time: 0.078475 Apr 14 12:21:24 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 315/938] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:21:24 2023] POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:25 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:21:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-b8b2b6e9-370d-4795-8874-999b5cbc6cde tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1554 microversion: 2.1 time: 0.170586 Apr 14 12:21:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 312/939] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:24 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=12 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:25 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:21:25 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-ce18fe7e-a91a-4191-b593-30d895787ef2 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1492 microversion: 2.1 time: 0.277359 Apr 14 12:21:25 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 313/940] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:25 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1492 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:21:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:21:29 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 HTTP/1.1 Apr 14 12:21:29 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:21:29 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:21:29 user devstack@n-api.service[61699]: Connection: close Apr 14 12:21:29 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:21:29 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:21:29 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:21:29 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:21:29 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:21:29 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:21:29 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:21:29 user devstack@n-api.service[61699]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:21:29 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:21:29 user devstack@n-api.service[61699]: method: > Apr 14 12:21:29 user devstack@n-api.service[61699]: exception: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:21:29 user devstack@n-api.service[61699]: action_args: {'id': '9741284c-15ce-41e3-934d-bf8f46a407f5'} Apr 14 12:21:29 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:21:29 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:21:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:21:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d75ea5b3-e98b-4b7f-ae73-117b0a6778f5 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 404 len: 111 microversion: 2.1 time: 0.027742 Apr 14 12:21:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 316/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:28 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:21:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-015f9540-4bfe-4d1e-b3b7-47ddd79ef0e0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '.version_select at 0x7f437177d090>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-015f9540-4bfe-4d1e-b3b7-47ddd79ef0e0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529761837" status: 202 len: 0 microversion: 2.1 time: 0.024517 Apr 14 12:21:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 313/942] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:21:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529761837 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:21:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-76e6350f-8d4a-4c48-af3d-14a4965d378d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: .version_select at 0x7f4371c42d40>, body: {"keypair": {"name": "tempest-keypair-1624862949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB96+f0AatgHhQTr5ZIzP5ZL6VMvJr14C7rX7dyUdqDa2UfR0mbSC6G+D3OgiyapBaouDNuGoibx3vNl8NGrNsEkxu3grUfD65+47/2jjpoMwNkaENry5dTv4634Q31q8Q=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:29 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-76e6350f-8d4a-4c48-af3d-14a4965d378d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for project 90ff3910da7c47e9828549306fda25d7. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:21:29 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-76e6350f-8d4a-4c48-af3d-14a4965d378d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for user b7a65855384e4146a344cceb744e3e40 and project 90ff3910da7c47e9828549306fda25d7. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:21:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-76e6350f-8d4a-4c48-af3d-14a4965d378d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046750 Apr 14 12:21:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 314/943] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:21:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2146413711", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8f65a07f-a522-4aac-a358-42db7baf614d"}], "security_groups": [{"name": "tempest-securitygroup--959800377"}], "key_name": "tempest-keypair-1624862949", "user_data": "}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:31 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] validate_networks() for [('8f65a07f-a522-4aac-a358-42db7baf614d', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for project 90ff3910da7c47e9828549306fda25d7. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Getting quotas for user b7a65855384e4146a344cceb744e3e40 and project 90ff3910da7c47e9828549306fda25d7. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:21:32 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:21:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-338f509e-dcb9-40e9-94f4-50eb1da05711 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.799627 Apr 14 12:21:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 317/944] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:21:31 2023] POST /compute/v2.1/servers => generated 399 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:21:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-0b43454b-abb0-4dc4-8140-aad201fd578c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:32 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-0b43454b-abb0-4dc4-8140-aad201fd578c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:32 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-0b43454b-abb0-4dc4-8140-aad201fd578c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:21:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-0b43454b-abb0-4dc4-8140-aad201fd578c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 200 len: 1232 microversion: 2.1 time: 0.070645 Apr 14 12:21:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 314/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:32 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 1232 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:34 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:34 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:34 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] Creating event network-changed:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:21:34 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f2dead22-0f10-4eed-98ad-72b3d463af38 req-c7d3969f-a350-44e5-ad30-ee9835aefcb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036800 Apr 14 12:21:34 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 318/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:35 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:21:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a31c04f8-992a-44ac-976b-d7f541a0932e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 200 len: 1439 microversion: 2.1 time: 0.311445 Apr 14 12:21:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 315/947] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:34 2023] GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 1439 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:21:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "name": "network-vif-plugged", "status": "completed", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:37 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] Creating event network-vif-plugged:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:21:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-24f70474-1b7e-4c84-819f-1c8bc839189c req-7093d25b-5649-42f2-8395-e0326753ba75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052538 Apr 14 12:21:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 315/948] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "name": "network-vif-plugged", "status": "completed", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] Creating event network-vif-plugged:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:21:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-0d9e2de6-957d-4d16-af6b-a2018325ba41 req-9b1f6e12-3822-4502-bdae-dcbb30f1e373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028414 Apr 14 12:21:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 319/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 95db2830-1af3-49e6-af4b-bb8805db707a] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] HTTP exception thrown: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Request method failure captured: Apr 14 12:21:41 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a HTTP/1.1 Apr 14 12:21:41 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:21:41 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:21:41 user devstack@n-api.service[61701]: Connection: close Apr 14 12:21:41 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:21:41 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:21:41 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:21:41 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:21:41 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUSwDW5NbzSgjRUb6X8N06fE8I4y5VlAP8IVAv5A_I_b5ADB7BgKqGRINClvwkpDsLPrg5FDZaoNad_k-GZSYJl4lM5W0u0FYkUK7mp69IQRjNA6kdMi_ud1VFazT0y2OfDuG7PjlRNvoc8Y4qenBUYK2DcgOsmZzcDNhruOM5dKdks Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Project-Id: 9743d731274a493488bbf9df3d65d073 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Project-Name: tempest-VolumesActionsTest-993773268 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9743d731274a493488bbf9df3d65d073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9743d731274a493488bbf9df3d65d073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9743d731274a493488bbf9df3d65d073"}]}] Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Tenant: tempest-VolumesActionsTest-993773268 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Tenant-Id: 9743d731274a493488bbf9df3d65d073 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-VolumesActionsTest-993773268 Apr 14 12:21:41 user devstack@n-api.service[61701]: X-User: tempest-VolumesActionsTest-993773268-project-member Apr 14 12:21:41 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:21:41 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:21:41 user devstack@n-api.service[61701]: X-User-Id: e05e233f8bc749289056606d7046b38d Apr 14 12:21:41 user devstack@n-api.service[61701]: X-User-Name: tempest-VolumesActionsTest-993773268-project-member Apr 14 12:21:41 user devstack@n-api.service[61701]: method: > Apr 14 12:21:41 user devstack@n-api.service[61701]: exception: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. Apr 14 12:21:41 user devstack@n-api.service[61701]: action_args: {'id': '95db2830-1af3-49e6-af4b-bb8805db707a'} Apr 14 12:21:41 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. Apr 14 12:21:41 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:21:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Returning 404 to user: Instance 95db2830-1af3-49e6-af4b-bb8805db707a could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:21:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e59a72dc-ee97-42e1-9381-1a7cc04e14d2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a" status: 404 len: 111 microversion: 2.1 time: 0.033118 Apr 14 12:21:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 316/950] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:41 2023] GET /compute/v2.1/servers/95db2830-1af3-49e6-af4b-bb8805db707a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2121882538", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "61b8bcf7-3906-43bf-a28f-4b184513279c"}]}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.network.neutron [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] validate_networks() for [('61b8bcf7-3906-43bf-a28f-4b184513279c', None, None, None, None, None)] {{(pid=61700) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image limits 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Flavor pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Image pref 0:0:0 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.virt.hardware [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting quotas for project 9743d731274a493488bbf9df3d65d073. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Getting quotas for user e05e233f8bc749289056606d7046b38d and project 9743d731274a493488bbf9df3d65d073. Resources: {'instances', 'ram', 'cores'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Going to run 1 instances... {{(pid=61700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:21:41 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:21:41 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-312a8627-b4c8-4d8f-a748-b6763ed73fe2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.603248 Apr 14 12:21:41 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 316/951] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:21:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:21:41 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ddfa77bb-1ed6-43d7-acff-65672a768ca7 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:21:41 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ddfa77bb-1ed6-43d7-acff-65672a768ca7 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:21:41 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-ddfa77bb-1ed6-43d7-acff-65672a768ca7 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:21:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ddfa77bb-1ed6-43d7-acff-65672a768ca7 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61" status: 200 len: 1208 microversion: 2.1 time: 0.073126 Apr 14 12:21:41 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 320/952] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:21:41 2023] GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 => generated 1208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:21:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] Creating event network-changed:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:21:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-de6a7547-419d-413e-b31a-bab8a8730573 req-ace93eb3-2030-4102-87fb-1e6ac9c982e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036453 Apr 14 12:21:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 317/953] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:46 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "name": "network-vif-plugged", "status": "completed", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:46 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] Creating event network-vif-plugged:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:21:46 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-51343e18-7852-4dc9-ba08-33e74c5d771a req-bd726ce4-85f1-4693-a673-a6fee99a8693 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035320 Apr 14 12:21:46 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 317/954] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:21:48 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "name": "network-vif-plugged", "status": "completed", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:21:48 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:21:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:21:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:21:48 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:21:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] Creating event network-vif-plugged:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:21:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-8d47e953-91e0-4c9b-8e9a-9e315db97e81 req-b9b57231-27e4-4df2-b2b0-cbe0d31f2b3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Apr 14 12:21:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 321/955] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=16 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:15 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:15 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-3503026a-48bd-40b3-90a9-17325be89aad tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1546 microversion: 2.1 time: 0.152774 Apr 14 12:22:15 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 318/956] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:15 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:22 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ccc91877-c2c3-4225-a6fa-4ed29088124d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 200 len: 1537 microversion: 2.1 time: 0.259136 Apr 14 12:22:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 318/957] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:22 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7895c3bd-3ea8-497e-aad4-d2ebf14799be tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-658783223", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "destination_type": "local"}, {"source_type": "volume", "uuid": "3d695a68-fbc2-48c9-9eb8-d76ecbfb4ea3", "destination_type": "invalid"}], "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7895c3bd-3ea8-497e-aad4-d2ebf14799be tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:22:28 user devstack@n-api.service[61699]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 12:22:28 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:22:28 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:22:28 user devstack@n-api.service[61699]: Connection: close Apr 14 12:22:28 user devstack@n-api.service[61699]: Content-Length: 493 Apr 14 12:22:28 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:22:28 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:22:28 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:22:28 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:22:28 user devstack@n-api.service[61699]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:22:28 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:22:28 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:22:28 user devstack@n-api.service[61699]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:22:28 user devstack@n-api.service[61699]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:22:28 user devstack@n-api.service[61699]: Apr 14 12:22:28 user devstack@n-api.service[61699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-658783223", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "destination_type": "local"}, {"source_type": "volume", "uuid": "3d695a68-fbc2-48c9-9eb8-d76ecbfb4ea3", "destination_type": "invalid"}], "networks": [{"uuid": "42f6438c-9c79-4fe5-875b-1b5b5b9b0dda"}]}} Apr 14 12:22:28 user devstack@n-api.service[61699]: method: > Apr 14 12:22:28 user devstack@n-api.service[61699]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 12:22:28 user devstack@n-api.service[61699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-658783223', 'imageRef': 'a84e226d-f438-4fb3-96fe-51f5960a6c87', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a84e226d-f438-4fb3-96fe-51f5960a6c87', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3d695a68-fbc2-48c9-9eb8-d76ecbfb4ea3', 'destination_type': 'invalid'}], 'networks': [{'uuid': '42f6438c-9c79-4fe5-875b-1b5b5b9b0dda'}]}}} Apr 14 12:22:28 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise error Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 12:22:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:22:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7895c3bd-3ea8-497e-aad4-d2ebf14799be tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:22:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7895c3bd-3ea8-497e-aad4-d2ebf14799be tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009164 Apr 14 12:22:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 322/958] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:22:28 2023] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:28 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:28 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f869c469-23af-455f-9021-4fb3241487d1 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1492 microversion: 2.1 time: 0.141501 Apr 14 12:22:28 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 319/959] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:28 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1492 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:31 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:32 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-66d4406f-fa7b-4d39-9209-a41189b2ad96 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61" status: 200 len: 1487 microversion: 2.1 time: 0.217504 Apr 14 12:22:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 319/960] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:31 2023] GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 => generated 1487 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e831c2df-0556-42ea-80d1-a0dfe7a936cd tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 200 len: 1439 microversion: 2.1 time: 0.224959 Apr 14 12:22:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 323/961] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:35 2023] GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 1439 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] Creating event network-changed:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:22:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-7bdf2ce3-668d-461b-9746-ce5aab99da7a req-fe68fb2e-07fa-43c4-bb6e-fb2e408e962f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034972 Apr 14 12:22:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 320/962] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:38 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:22:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-d2b137e0-eabd-43ef-a741-33d303cbf7b3 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 204 len: 0 microversion: 2.1 time: 0.172872 Apr 14 12:22:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 320/963] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:22:38 2023] DELETE /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:38 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:22:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b4c0fe1d-16a6-4324-b099-9f3ebfac3493 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 200 len: 1564 microversion: 2.1 time: 0.222774 Apr 14 12:22:38 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 324/964] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:22:38 2023] GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:22:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "name": "network-vif-unplugged", "status": "completed", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] Creating event network-vif-unplugged:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:22:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-aafde080-400d-4225-b7d6-36842313fbd5 req-dec6b734-0331-43f0-81ab-cab556156502 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031607 Apr 14 12:22:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 321/965] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:22:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] Creating event network-changed:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:22:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-dd06d470-8e0e-4c6f-ae65-d89f98581e04 req-fd2e6b26-fc41-4739-8292-6a36c4e79cf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039795 Apr 14 12:22:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 321/966] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:22:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:22:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "name": "network-vif-plugged", "status": "completed", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] Creating event network-vif-plugged:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:22:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-de7beda1-869c-45be-8213-3f3c35f24d73 req-b4d9bda4-1be6-4394-bda2-8acaec82e137 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Apr 14 12:22:40 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 325/967] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:22:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87d13b7-b18b-4645-bf3f-8f1afbc67b42", "name": "network-vif-deleted", "tag": "c53afdeb-2fc8-4aaf-bd49-0152c66bd222"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:22:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:22:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:22:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:22:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] Creating event network-vif-deleted:c53afdeb-2fc8-4aaf-bd49-0152c66bd222 for instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 on user Apr 14 12:22:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-61eb3f69-145f-4520-a57c-35e572273ead req-8c1a3c44-44ca-4df0-8c29-0e22499375af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028293 Apr 14 12:22:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 322/968] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:22:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:15 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:15 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3f6759d5-6085-4861-99aa-b6d71efc1e54 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1546 microversion: 2.1 time: 0.396755 Apr 14 12:23:15 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:15 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1546 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=14 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:15 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3e094d24-57f9-479d-ac0e-6e4099de79bd tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action" status: 200 len: 28374 microversion: 2.1 time: 0.232022 Apr 14 12:23:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 326/970] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:23:15 2023] POST /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879/action => generated 28374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=8 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=12 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:16 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-126e13a9-ec27-42cd-90cc-d2560daa4068 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 200 len: 1539 microversion: 2.1 time: 0.202707 Apr 14 12:23:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 323/971] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:16 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2819a9f7-6910-4551-9168-9b143bc801ac tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100431 Apr 14 12:23:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 323/972] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:23:22 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-interface => generated 283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] Creating event network-changed:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:23:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2fe55521-5e99-4165-ab3e-bbb9f0a22254 req-85150d7e-cf34-4d69-ab07-023a5f781e83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Apr 14 12:23:23 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 327/973] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:23 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8ee0588e-8e24-4749-bf53-71d2dbb718f3 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/ips" status: 200 len: 104 microversion: 2.1 time: 0.038873 Apr 14 12:23:23 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 324/974] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:23:23 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/ips => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b39de44-631b-4fd2-b6ff-65371c884973"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:26 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-eedbae3a-b1ba-42bb-81ae-4486a3d17e66 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312943 Apr 14 12:23:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 324/975] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:23:26 2023] POST /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: d87d13b7-b18b-4645-bf3f-8f1afbc67b42] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:23:28 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 HTTP/1.1 Apr 14 12:23:28 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:23:28 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:23:28 user devstack@n-api.service[61699]: Connection: close Apr 14 12:23:28 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:23:28 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:23:28 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:23:28 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:23:28 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:23:28 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:23:28 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:23:28 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:23:28 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:23:28 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:23:28 user devstack@n-api.service[61699]: method: > Apr 14 12:23:28 user devstack@n-api.service[61699]: exception: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. Apr 14 12:23:28 user devstack@n-api.service[61699]: action_args: {'id': 'd87d13b7-b18b-4645-bf3f-8f1afbc67b42'} Apr 14 12:23:28 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. Apr 14 12:23:28 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance d87d13b7-b18b-4645-bf3f-8f1afbc67b42 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:23:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-24fee339-067b-4b00-988f-e7aee426c59c tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42" status: 404 len: 111 microversion: 2.1 time: 0.124022 Apr 14 12:23:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 328/976] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:28 2023] GET /compute/v2.1/servers/d87d13b7-b18b-4645-bf3f-8f1afbc67b42 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:23:33 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:33 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=10 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:34 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:34 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4d860b63-372f-48d6-87cf-c20d6420657a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087509 Apr 14 12:23:34 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 325/977] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:23:33 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-400ff14e-82f5-4668-9beb-b85f3b2519de tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973" status: 200 len: 194 microversion: 2.1 time: 0.072316 Apr 14 12:23:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 12:23:34 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:23:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-aa98b93a-fa10-4dc9-9478-223be582f28d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61" status: 204 len: 0 microversion: 2.1 time: 0.271407 Apr 14 12:23:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 329/979] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:23:35 2023] DELETE /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:35 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05e233f8bc749289056606d7046b38d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9743d731274a493488bbf9df3d65d073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-90ff3d58-fbc4-470a-a3d7-e59c3b21bfd2 tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61" status: 200 len: 1493 microversion: 2.1 time: 0.372759 Apr 14 12:23:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 326/980] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:35 2023] GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 => generated 1493 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:23:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "name": "network-vif-unplugged", "status": "completed", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] Creating event network-vif-unplugged:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:23:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-cc35043e-ce17-457d-9e01-dab90a2a16a1 req-e098dfc4-a08b-4c4f-89d8-1af0597d9f9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132360 Apr 14 12:23:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 326/981] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] HTTP exception thrown: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:23:36 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 HTTP/1.1 Apr 14 12:23:36 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:23:36 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:23:36 user devstack@n-api.service[61699]: Connection: close Apr 14 12:23:36 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:23:36 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:23:36 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:23:36 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:23:36 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61699]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:23:36 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:23:36 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:23:36 user devstack@n-api.service[61699]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:23:36 user devstack@n-api.service[61699]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:23:36 user devstack@n-api.service[61699]: method: > Apr 14 12:23:36 user devstack@n-api.service[61699]: exception: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61699]: action_args: {'id': '92742ea2-11c2-4701-aafc-4b49787881a4'} Apr 14 12:23:36 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 404 to user: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:23:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-06a23e36-f3de-4f6c-bad0-c593c1e014d7 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 404 len: 111 microversion: 2.1 time: 0.060199 Apr 14 12:23:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 330/982] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:23:36 2023] DELETE /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: 92742ea2-11c2-4701-aafc-4b49787881a4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] HTTP exception thrown: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:23:36 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 HTTP/1.1 Apr 14 12:23:36 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:23:36 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:23:36 user devstack@n-api.service[61701]: Connection: close Apr 14 12:23:36 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:23:36 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:23:36 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:23:36 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:23:36 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:23:36 user devstack@n-api.service[61701]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:23:36 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:23:36 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:23:36 user devstack@n-api.service[61701]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:23:36 user devstack@n-api.service[61701]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:23:36 user devstack@n-api.service[61701]: method: > Apr 14 12:23:36 user devstack@n-api.service[61701]: exception: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61701]: action_args: {'id': '92742ea2-11c2-4701-aafc-4b49787881a4'} Apr 14 12:23:36 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. Apr 14 12:23:36 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 404 to user: Instance 92742ea2-11c2-4701-aafc-4b49787881a4 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:23:36 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5e154d72-b4a0-4cd0-bbae-82ee2512cc98 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4" status: 404 len: 111 microversion: 2.1 time: 0.061043 Apr 14 12:23:36 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 327/983] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:36 2023] GET /compute/v2.1/servers/92742ea2-11c2-4701-aafc-4b49787881a4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:23:36 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-eb5d8961-ea9b-431f-90c3-41f50301dc39 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 204 len: 0 microversion: 2.1 time: 0.166241 Apr 14 12:23:36 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 327/984] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:23:36 2023] DELETE /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2842569-143c-4da8-9bcf-1d531587d323"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:36 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:36 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4063336b73e44ed991ca650d60bb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c6e3aceb3445c8bed09847c92f271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:36 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-dfe7e9bc-572c-46f2-bebe-a07c2d858c45 tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 200 len: 1498 microversion: 2.1 time: 0.546743 Apr 14 12:23:36 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 331/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:36 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 1498 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:23:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] Creating event network-vif-unplugged:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:23:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-5dbe8a76-558c-44df-8f33-8787f246fe9b req-fbb800a7-f8e5-46df-8373-e2d84b0a8d89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141517 Apr 14 12:23:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 328/986] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-59bc48ea-a838-415f-8636-0200e050f28a tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455865 Apr 14 12:23:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 328/987] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:23:36 2023] POST /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:37 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "name": "network-vif-plugged", "status": "completed", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}, {"server_uuid": "1c58eb62-6938-41e2-b1c7-603c81b8db61", "name": "network-vif-deleted", "tag": "66315514-390f-44a2-83ab-92b696400a9a"}, {"server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "name": "network-vif-deleted", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:38 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Creating event network-vif-plugged:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:23:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Creating event network-vif-deleted:66315514-390f-44a2-83ab-92b696400a9a for instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 on user Apr 14 12:23:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] Creating event network-vif-deleted:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:23:38 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-2ad78f7a-0822-4389-ba0e-f4f7a496fcae req-c8a2c11a-eaec-42da-8ec2-6d8a55883c2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040025 Apr 14 12:23:38 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 332/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e745394e-1cf2-40d8-a7ec-003677309895", "name": "network-vif-plugged", "status": "completed", "tag": "4b8b30df-bc81-40b6-830e-c9846bb3b98e"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] Creating event network-vif-plugged:4b8b30df-bc81-40b6-830e-c9846bb3b98e for instance e745394e-1cf2-40d8-a7ec-003677309895 on user Apr 14 12:23:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-e91556e4-4c53-4b64-8e45-2ecfec04ba74 req-6374c76c-612c-4d7e-a04f-c8aefb3d1d78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029704 Apr 14 12:23:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 329/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] Creating event network-changed:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:23:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f5573c58-dafe-4a72-a25a-d2ef02c3dd8b req-59943b0d-b6d4-4000-ac07-30d0611a992d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032691 Apr 14 12:23:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 333/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:39 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:23:39 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-54b02740-5748-47f3-9702-06951cccbc19 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 204 len: 0 microversion: 2.1 time: 0.118349 Apr 14 12:23:39 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 329/991] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:23:39 2023] DELETE /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:39 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511fd95d993e4837a4a612385b04fdcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c317cb8d6a44115b216678540c433b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:39 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-608e4d38-64ad-420b-b5b6-849ce03e2554 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 200 len: 1564 microversion: 2.1 time: 0.181620 Apr 14 12:23:39 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 330/992] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:39 2023] GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:23:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "name": "network-vif-deleted", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] Creating event network-vif-deleted:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:23:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-5721e350-38d4-4f00-87b5-49717e41698c req-3c22347a-ccd6-4576-bfba-5af4d188b7d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 Apr 14 12:23:41 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 334/993] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:41 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "name": "network-vif-unplugged", "status": "completed", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}, {"server_uuid": "72e19f85-7f50-456a-a0af-b16e68471077", "name": "network-vif-plugged", "status": "completed", "tag": "16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:41 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Creating event network-vif-unplugged:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:23:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] Creating event network-vif-plugged:16c54e3f-13ea-45ce-ab0d-fa6a0bb2088e for instance 72e19f85-7f50-456a-a0af-b16e68471077 on user Apr 14 12:23:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-c21d1dc5-ecd6-4d5e-bc93-e75faf44d74b req-3b50df4a-6ed9-4ea7-9e4f-4cac9ee6a075 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032478 Apr 14 12:23:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 330/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7fb04dd2-c0ea-4dc6-8dc7-2648e6b9fcb7 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046811 Apr 14 12:23:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 331/995] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:23:44 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:45 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1a15c8c1-18c1-4ce8-815a-504470b8c97c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973" status: 200 len: 194 microversion: 2.1 time: 0.040297 Apr 14 12:23:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 335/996] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 12:23:45 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:45 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'services' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:23:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-0ded48e7-2f59-4253-ae8c-112af02b39ae tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973" status: 202 len: 0 microversion: 2.1 time: 0.170378 Apr 14 12:23:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 331/997] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:23:45 2023] DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/5b39de44-631b-4fd2-b6ff-65371c884973 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:47 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c623b79c-84aa-4e2c-88dc-854309ad7c70 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/b2842569-143c-4da8-9bcf-1d531587d323" status: 200 len: 194 microversion: 2.1 time: 0.043543 Apr 14 12:23:47 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 332/998] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 12:23:47 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/b2842569-143c-4da8-9bcf-1d531587d323 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:23:47 user devstack@n-api.service[61699]: DEBUG nova.objects.instance [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lazy-loading 'services' on Instance uuid 4614224c-932d-4ab9-af71-5ee2b79c2868 {{(pid=61699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:23:47 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-23ec151c-7aca-4ac3-b6a3-55c472a8b136 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/b2842569-143c-4da8-9bcf-1d531587d323" status: 202 len: 0 microversion: 2.1 time: 0.166627 Apr 14 12:23:47 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 336/999] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:23:47 2023] DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments/b2842569-143c-4da8-9bcf-1d531587d323 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:49 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:49 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-fb61009b-32f8-4aa0-b027-a39cc612983c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046131 Apr 14 12:23:49 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 332/1000] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:23:49 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-98ed03eb-0a3e-422d-98bc-1d45bbc96a2b tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044183 Apr 14 12:23:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 333/1001] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:23:50 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:23:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-826ea1ad-4df4-4273-9cb7-8407edb3b3df tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 204 len: 0 microversion: 2.1 time: 0.113157 Apr 14 12:23:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 337/1002] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:23:50 2023] DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a65855384e4146a344cceb744e3e40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ff3910da7c47e9828549306fda25d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:23:50 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f03b9cea-b4ab-4e70-a01b-8089435eb86d tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 200 len: 1662 microversion: 2.1 time: 0.224833 Apr 14 12:23:50 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 333/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:23:50 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 1662 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "name": "network-vif-unplugged", "status": "completed", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] Creating event network-vif-unplugged:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:23:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-1faf44d0-198c-401f-9246-56589fc71915 req-47a9a488-bcbe-40cf-b5b0-4c41a85de5c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028255 Apr 14 12:23:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 334/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:23:52 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "name": "network-vif-plugged", "status": "completed", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}, {"server_uuid": "4614224c-932d-4ab9-af71-5ee2b79c2868", "name": "network-vif-deleted", "tag": "ed203286-06b3-4aa0-972f-5b3b85864e00"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:23:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:23:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:23:52 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:23:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Creating event network-vif-plugged:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:23:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] Creating event network-vif-deleted:ed203286-06b3-4aa0-972f-5b3b85864e00 for instance 4614224c-932d-4ab9-af71-5ee2b79c2868 on user Apr 14 12:23:52 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7f46d3d2-ed19-4aa4-be66-331fd100cfd1 req-d3a1d8a8-9420-41de-957f-4cbb5e00771a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036642 Apr 14 12:23:52 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 338/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:16 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:24:16 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d0ca070f-2cd3-49ca-a181-617529b506c5 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 204 len: 0 microversion: 2.1 time: 0.214411 Apr 14 12:24:16 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:24:16 2023] DELETE /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=5 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=13 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-unplugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:24:16 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-fe9cd989-0a80-49f5-970c-937265c364d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 200 len: 1552 microversion: 2.1 time: 0.226595 Apr 14 12:24:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 335/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:16 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 1552 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:24:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] Creating event network-vif-unplugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:24:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-9595dbd3-c7ee-46b0-9b17-0b3304938eb8 req-9d6140ff-7f61-40b5-9059-b5deffbbe6d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039174 Apr 14 12:24:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 339/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:24:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:24:18 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-plugged", "status": "completed", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}, {"server_uuid": "1324bca1-ccba-417a-ac3d-c1828a0de879", "name": "network-vif-deleted", "tag": "95e757cd-56ba-460d-810a-2e9dd9d29919"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:24:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:18 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Creating event network-vif-plugged:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:24:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] Creating event network-vif-deleted:95e757cd-56ba-460d-810a-2e9dd9d29919 for instance 1324bca1-ccba-417a-ac3d-c1828a0de879 on user Apr 14 12:24:18 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-de0c77f7-3015-4153-ac3a-d3d26cb03768 req-c0ef1f48-3946-4050-b9d2-c04fc45be572 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041426 Apr 14 12:24:18 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 335/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:24:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] [instance: 1c58eb62-6938-41e2-b1c7-603c81b8db61] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] HTTP exception thrown: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Request method failure captured: Apr 14 12:24:25 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 HTTP/1.1 Apr 14 12:24:25 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:24:25 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:24:25 user devstack@n-api.service[61700]: Connection: close Apr 14 12:24:25 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:24:25 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:24:25 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:24:25 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:24:25 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUSwDW5NbzSgjRUb6X8N06fE8I4y5VlAP8IVAv5A_I_b5ADB7BgKqGRINClvwkpDsLPrg5FDZaoNad_k-GZSYJl4lM5W0u0FYkUK7mp69IQRjNA6kdMi_ud1VFazT0y2OfDuG7PjlRNvoc8Y4qenBUYK2DcgOsmZzcDNhruOM5dKdks Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Project-Id: 9743d731274a493488bbf9df3d65d073 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Project-Name: tempest-VolumesActionsTest-993773268 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9743d731274a493488bbf9df3d65d073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9743d731274a493488bbf9df3d65d073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9743d731274a493488bbf9df3d65d073"}]}] Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Tenant: tempest-VolumesActionsTest-993773268 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Tenant-Id: 9743d731274a493488bbf9df3d65d073 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-VolumesActionsTest-993773268 Apr 14 12:24:25 user devstack@n-api.service[61700]: X-User: tempest-VolumesActionsTest-993773268-project-member Apr 14 12:24:25 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:24:25 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:24:25 user devstack@n-api.service[61700]: X-User-Id: e05e233f8bc749289056606d7046b38d Apr 14 12:24:25 user devstack@n-api.service[61700]: X-User-Name: tempest-VolumesActionsTest-993773268-project-member Apr 14 12:24:25 user devstack@n-api.service[61700]: method: > Apr 14 12:24:25 user devstack@n-api.service[61700]: exception: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. Apr 14 12:24:25 user devstack@n-api.service[61700]: action_args: {'id': '1c58eb62-6938-41e2-b1c7-603c81b8db61'} Apr 14 12:24:25 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. Apr 14 12:24:25 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:25 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] Returning 404 to user: Instance 1c58eb62-6938-41e2-b1c7-603c81b8db61 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:25 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5d502806-af71-4d78-ba9a-4e0e209edb6d tempest-VolumesActionsTest-993773268 tempest-VolumesActionsTest-993773268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61" status: 404 len: 111 microversion: 2.1 time: 0.125631 Apr 14 12:24:25 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:25 2023] GET /compute/v2.1/servers/1c58eb62-6938-41e2-b1c7-603c81b8db61 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] [instance: e745394e-1cf2-40d8-a7ec-003677309895] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] HTTP exception thrown: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Request method failure captured: Apr 14 12:24:27 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 HTTP/1.1 Apr 14 12:24:27 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:24:27 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:24:27 user devstack@n-api.service[61699]: Connection: close Apr 14 12:24:27 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:24:27 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:24:27 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:24:27 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:24:27 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUO47qMrqGOxP8Jn_aoqWa0Qd9CglUIuNVySGp0LICtrDmoBBDyGm2PV9YLNyNSwOqFKkfOm-ipl4Abms9Ql5dfBaXXMlsCLKNNJMj5u4MRjm0G5G_iFkEmpZLwFgXZjBM8r8hiMwVbKEVTT8h-egE51WkasUKuVTD7Hy3BpXdTObPk Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Project-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930c6e3aceb3445c8bed09847c92f271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930c6e3aceb3445c8bed09847c92f271"}]}] Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Tenant: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Tenant-Id: 930c6e3aceb3445c8bed09847c92f271 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103109288 Apr 14 12:24:27 user devstack@n-api.service[61699]: X-User: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:24:27 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:24:27 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:24:27 user devstack@n-api.service[61699]: X-User-Id: f4063336b73e44ed991ca650d60bb3cd Apr 14 12:24:27 user devstack@n-api.service[61699]: X-User-Name: tempest-ServersNegativeTestJSON-1103109288-project-member Apr 14 12:24:27 user devstack@n-api.service[61699]: method: > Apr 14 12:24:27 user devstack@n-api.service[61699]: exception: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. Apr 14 12:24:27 user devstack@n-api.service[61699]: action_args: {'id': 'e745394e-1cf2-40d8-a7ec-003677309895'} Apr 14 12:24:27 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. Apr 14 12:24:27 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] Returning 404 to user: Instance e745394e-1cf2-40d8-a7ec-003677309895 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-499c378e-123f-41d4-a8cd-1c7ce0467adf tempest-ServersNegativeTestJSON-1103109288 tempest-ServersNegativeTestJSON-1103109288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895" status: 404 len: 111 microversion: 2.1 time: 0.030001 Apr 14 12:24:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 340/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:27 2023] GET /compute/v2.1/servers/e745394e-1cf2-40d8-a7ec-003677309895 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 72e19f85-7f50-456a-a0af-b16e68471077] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:24:29 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 HTTP/1.1 Apr 14 12:24:29 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:24:29 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:24:29 user devstack@n-api.service[61701]: Connection: close Apr 14 12:24:29 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:24:29 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:24:29 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:24:29 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:24:29 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:29 user devstack@n-api.service[61701]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:29 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:24:29 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:24:29 user devstack@n-api.service[61701]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:24:29 user devstack@n-api.service[61701]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:29 user devstack@n-api.service[61701]: method: > Apr 14 12:24:29 user devstack@n-api.service[61701]: exception: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. Apr 14 12:24:29 user devstack@n-api.service[61701]: action_args: {'id': '72e19f85-7f50-456a-a0af-b16e68471077'} Apr 14 12:24:29 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. Apr 14 12:24:29 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 72e19f85-7f50-456a-a0af-b16e68471077 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f480f29b-1fcb-4c12-b15f-a9df090c586e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077" status: 404 len: 111 microversion: 2.1 time: 0.040494 Apr 14 12:24:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:29 2023] GET /compute/v2.1/servers/72e19f85-7f50-456a-a0af-b16e68471077 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:24:30 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db HTTP/1.1 Apr 14 12:24:30 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:24:30 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:24:30 user devstack@n-api.service[61700]: Connection: close Apr 14 12:24:30 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:24:30 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:24:30 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:24:30 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:24:30 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61700]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:30 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:24:30 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:24:30 user devstack@n-api.service[61700]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:24:30 user devstack@n-api.service[61700]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:30 user devstack@n-api.service[61700]: method: > Apr 14 12:24:30 user devstack@n-api.service[61700]: exception: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61700]: action_args: {'id': '8b6f277a-7fde-43db-81be-ed9aaab827db'} Apr 14 12:24:30 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a4bab031-69d6-4fd5-af83-a758de00c63e tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 404 len: 111 microversion: 2.1 time: 0.031742 Apr 14 12:24:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 337/1013] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:24:30 2023] DELETE /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] [instance: 8b6f277a-7fde-43db-81be-ed9aaab827db] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] HTTP exception thrown: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Request method failure captured: Apr 14 12:24:30 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db HTTP/1.1 Apr 14 12:24:30 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:24:30 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:24:30 user devstack@n-api.service[61699]: Connection: close Apr 14 12:24:30 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:24:30 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:24:30 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:24:30 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:24:30 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUHvVYZvD0jsODIgeyUWgvzkGS1baNbG5SB_D0LmsdPuryKN8WtdC0eXM6tVcT6FLF7XLehiI04fy3h8KUF6YLVDw_OGFs1tFb6mZ-SUnx0a5_RdrQdjTLRMFNKh2ArlqoRM2srAC-7fjnzDrvvxR5zv2LrjFR4wAMNy44osUjT_Zq0 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Project-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c317cb8d6a44115b216678540c433b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c317cb8d6a44115b216678540c433b6"}]}] Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Tenant: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Tenant-Id: 0c317cb8d6a44115b216678540c433b6 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestVolumeBootPattern-2042813947 Apr 14 12:24:30 user devstack@n-api.service[61699]: X-User: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:30 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:24:30 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:24:30 user devstack@n-api.service[61699]: X-User-Id: 511fd95d993e4837a4a612385b04fdcb Apr 14 12:24:30 user devstack@n-api.service[61699]: X-User-Name: tempest-TestVolumeBootPattern-2042813947-project-member Apr 14 12:24:30 user devstack@n-api.service[61699]: method: > Apr 14 12:24:30 user devstack@n-api.service[61699]: exception: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61699]: action_args: {'id': '8b6f277a-7fde-43db-81be-ed9aaab827db'} Apr 14 12:24:30 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. Apr 14 12:24:30 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Returning 404 to user: Instance 8b6f277a-7fde-43db-81be-ed9aaab827db could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-17be351e-6e5b-49e0-a2b9-5b50d8f1fd91 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db" status: 404 len: 111 microversion: 2.1 time: 0.031416 Apr 14 12:24:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 341/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:30 2023] GET /compute/v2.1/servers/8b6f277a-7fde-43db-81be-ed9aaab827db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 12:24:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-bace9154-371d-4ce7-9d2b-19d818cb5728 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] Calling method '.version_select at 0x7f43716096c0>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-bace9154-371d-4ce7-9d2b-19d818cb5728 tempest-TestVolumeBootPattern-2042813947 tempest-TestVolumeBootPattern-2042813947-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-582531121" status: 202 len: 0 microversion: 2.1 time: 0.035140 Apr 14 12:24:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 12:24:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-582531121 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:24:40 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 HTTP/1.1 Apr 14 12:24:40 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:24:40 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:24:40 user devstack@n-api.service[61700]: Connection: close Apr 14 12:24:40 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:24:40 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:24:40 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:24:40 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:24:40 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:40 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:24:40 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:24:40 user devstack@n-api.service[61700]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:24:40 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:40 user devstack@n-api.service[61700]: method: > Apr 14 12:24:40 user devstack@n-api.service[61700]: exception: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:40 user devstack@n-api.service[61700]: action_args: {'id': '4614224c-932d-4ab9-af71-5ee2b79c2868'} Apr 14 12:24:40 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:40 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:40 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:40 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-17bf71d5-34bc-4cfb-a857-1ffdd1c9aabe tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 404 len: 111 microversion: 2.1 time: 0.052166 Apr 14 12:24:40 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 338/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:40 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2a9c1b5d-aafe-4159-b7f7-a8d3e91c63ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '.version_select at 0x7f43717ee8c0>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:40 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:40 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:41 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2a9c1b5d-aafe-4159-b7f7-a8d3e91c63ba tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624862949" status: 202 len: 0 microversion: 2.1 time: 0.333969 Apr 14 12:24:41 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:24:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624862949 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:24:51 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 HTTP/1.1 Apr 14 12:24:51 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:24:51 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:24:51 user devstack@n-api.service[61701]: Connection: close Apr 14 12:24:51 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:24:51 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:24:51 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:24:51 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:24:51 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:51 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:24:51 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:24:51 user devstack@n-api.service[61701]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:24:51 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:51 user devstack@n-api.service[61701]: method: > Apr 14 12:24:51 user devstack@n-api.service[61701]: exception: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61701]: action_args: {'id': '4614224c-932d-4ab9-af71-5ee2b79c2868'} Apr 14 12:24:51 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:51 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-89e96298-c3e3-4385-a541-7e813ac1f1f0 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 404 len: 111 microversion: 2.1 time: 0.074635 Apr 14 12:24:51 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:24:51 2023] DELETE /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 4614224c-932d-4ab9-af71-5ee2b79c2868] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:24:51 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 HTTP/1.1 Apr 14 12:24:51 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:24:51 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:24:51 user devstack@n-api.service[61700]: Connection: close Apr 14 12:24:51 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:24:51 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:24:51 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:24:51 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:24:51 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:51 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:24:51 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:24:51 user devstack@n-api.service[61700]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:24:51 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:51 user devstack@n-api.service[61700]: method: > Apr 14 12:24:51 user devstack@n-api.service[61700]: exception: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61700]: action_args: {'id': '4614224c-932d-4ab9-af71-5ee2b79c2868'} Apr 14 12:24:51 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. Apr 14 12:24:51 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:24:51 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 4614224c-932d-4ab9-af71-5ee2b79c2868 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:51 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7ae1a45c-cce4-46c1-a7bf-8a1ae4f5716c tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868" status: 404 len: 111 microversion: 2.1 time: 0.044970 Apr 14 12:24:51 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 339/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:51 2023] GET /compute/v2.1/servers/4614224c-932d-4ab9-af71-5ee2b79c2868 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:24:54 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 HTTP/1.1 Apr 14 12:24:54 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:24:54 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:24:54 user devstack@n-api.service[61699]: Connection: close Apr 14 12:24:54 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:24:54 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:24:54 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:24:54 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:24:54 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:54 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:24:54 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:24:54 user devstack@n-api.service[61699]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:24:54 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:54 user devstack@n-api.service[61699]: method: > Apr 14 12:24:54 user devstack@n-api.service[61699]: exception: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61699]: action_args: {'id': '9741284c-15ce-41e3-934d-bf8f46a407f5'} Apr 14 12:24:54 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:54 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-05e0c139-3cd0-407e-b234-757075bb2338 tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 404 len: 111 microversion: 2.1 time: 0.051635 Apr 14 12:24:54 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:24:54 2023] DELETE /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] [instance: 9741284c-15ce-41e3-934d-bf8f46a407f5] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:24:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] HTTP exception thrown: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Request method failure captured: Apr 14 12:24:54 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 HTTP/1.1 Apr 14 12:24:54 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:24:54 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:24:54 user devstack@n-api.service[61701]: Connection: close Apr 14 12:24:54 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:24:54 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:24:54 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:24:54 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:24:54 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOULcJDESXi92PRLWHLv9PWxrg-xiaFx-3Tnz8htEBUDbxqXZhyBkoA1lYaAJ_rBnsh-sSB6UR3vi-pbXy8mcZ-Ykm9TBFXHQ6N8g-a9tm5sj9kiXp3TDcVXo3Y_Q8HT3UHwlW9fKNIPeCJi20tt_Vkvmsenhk0qvbiO3Yo2vq6Najg4 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Project-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90ff3910da7c47e9828549306fda25d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90ff3910da7c47e9828549306fda25d7"}]}] Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Tenant-Id: 90ff3910da7c47e9828549306fda25d7 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-341361172 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:54 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:24:54 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:24:54 user devstack@n-api.service[61701]: X-User-Id: b7a65855384e4146a344cceb744e3e40 Apr 14 12:24:54 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeTestJSON-341361172-project-member Apr 14 12:24:54 user devstack@n-api.service[61701]: method: > Apr 14 12:24:54 user devstack@n-api.service[61701]: exception: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61701]: action_args: {'id': '9741284c-15ce-41e3-934d-bf8f46a407f5'} Apr 14 12:24:54 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. Apr 14 12:24:54 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:24:54 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] Returning 404 to user: Instance 9741284c-15ce-41e3-934d-bf8f46a407f5 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:24:54 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-0f789e49-7c7e-4988-9a8d-82164496a6bb tempest-AttachVolumeTestJSON-341361172 tempest-AttachVolumeTestJSON-341361172-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5" status: 404 len: 111 microversion: 2.1 time: 0.061476 Apr 14 12:24:54 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:24:54 2023] GET /compute/v2.1/servers/9741284c-15ce-41e3-934d-bf8f46a407f5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:25:06 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:06 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:06 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8660877b-0c16-4c81-ac27-e41f2e7ae01a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: .version_select at 0x7f43718f9630>, body: {"keypair": {"name": "tempest-keypair-1947744203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ZqjJNlf6FcYJIsVPd5Dq8NarYmFZ3EAxa4FpVKDQXSqboh3ngEuQm+3/ETqlNE/NPRoxD1k/GMhVZVbSixZx64hLBNYP8cF904WSQYGVXi3AQ5hvMZKO37FrgHGj9HQ=="}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:06 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-8660877b-0c16-4c81-ac27-e41f2e7ae01a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:25:06 user devstack@n-api.service[61700]: DEBUG nova.quota [None req-8660877b-0c16-4c81-ac27-e41f2e7ae01a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:25:06 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8660877b-0c16-4c81-ac27-e41f2e7ae01a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207556 Apr 14 12:25:06 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 340/1022] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:25:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:25:06 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 HTTP/1.1 Apr 14 12:25:06 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:25:06 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:25:06 user devstack@n-api.service[61699]: Connection: close Apr 14 12:25:06 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:25:06 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:25:06 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:25:06 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:25:06 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:06 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:25:06 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:25:06 user devstack@n-api.service[61699]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:25:06 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:06 user devstack@n-api.service[61699]: method: > Apr 14 12:25:06 user devstack@n-api.service[61699]: exception: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:06 user devstack@n-api.service[61699]: action_args: {'id': '1324bca1-ccba-417a-ac3d-c1828a0de879'} Apr 14 12:25:06 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:06 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:25:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ba1d34ea-6ed3-40e3-8382-c7aab332da60 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 404 len: 111 microversion: 2.1 time: 0.047910 Apr 14 12:25:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 344/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:06 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:25:06 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:25:07 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 HTTP/1.1 Apr 14 12:25:07 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:25:07 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:25:07 user devstack@n-api.service[61701]: Connection: close Apr 14 12:25:07 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:25:07 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:25:07 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:25:07 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:25:07 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:07 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:25:07 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:25:07 user devstack@n-api.service[61701]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:25:07 user devstack@n-api.service[61701]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:07 user devstack@n-api.service[61701]: method: > Apr 14 12:25:07 user devstack@n-api.service[61701]: exception: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61701]: action_args: {'id': '1324bca1-ccba-417a-ac3d-c1828a0de879'} Apr 14 12:25:07 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:25:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5add039f-6095-4ef9-aa5e-37a8a50d70ae tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 404 len: 111 microversion: 2.1 time: 0.039670 Apr 14 12:25:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:25:06 2023] DELETE /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 1324bca1-ccba-417a-ac3d-c1828a0de879] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:25:07 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 HTTP/1.1 Apr 14 12:25:07 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:25:07 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:25:07 user devstack@n-api.service[61700]: Connection: close Apr 14 12:25:07 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:25:07 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:25:07 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:25:07 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:25:07 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:07 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:25:07 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:25:07 user devstack@n-api.service[61700]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:25:07 user devstack@n-api.service[61700]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:07 user devstack@n-api.service[61700]: method: > Apr 14 12:25:07 user devstack@n-api.service[61700]: exception: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61700]: action_args: {'id': '1324bca1-ccba-417a-ac3d-c1828a0de879'} Apr 14 12:25:07 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. Apr 14 12:25:07 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 1324bca1-ccba-417a-ac3d-c1828a0de879 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:25:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-cdf13cba-f2e8-48fe-ac4a-2c50cdfc971c tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879" status: 404 len: 111 microversion: 2.1 time: 0.048678 Apr 14 12:25:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 341/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:07 2023] GET /compute/v2.1/servers/1324bca1-ccba-417a-ac3d-c1828a0de879 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:25:07 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-6ad8b187-5b07-4bdf-afe5-a89d387b36db tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 204 len: 0 microversion: 2.1 time: 0.137267 Apr 14 12:25:07 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 345/1026] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:25:07 2023] DELETE /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e264a59ff9b42e08095d0ce71e4d627', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4ff63247dd4535bcd86acfde76fd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:25:07 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-3d0bae6e-01e9-48dd-a864-93f2bfc0afe2 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 200 len: 1545 microversion: 2.1 time: 0.318567 Apr 14 12:25:07 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:07 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 1545 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "name": "network-vif-unplugged", "status": "completed", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] Creating event network-vif-unplugged:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:25:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-13ea943a-c6f1-4cbf-a6d9-531cd789978a req-5b0fee15-1755-43fc-a860-e5d74660c45e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036769 Apr 14 12:25:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 342/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:08 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1762137749", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d6bc94c-f0fd-4e85-8eab-51fca64de980"}], "security_groups": [{"name": "tempest-securitygroup--718365979"}], "key_name": "tempest-keypair-1947744203", "user_data": "}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:08 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] validate_networks() for [('3d6bc94c-f0fd-4e85-8eab-51fca64de980', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:25:09 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:25:09 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-2fc3fa7f-e8a8-4fb3-a52c-86859fa44414 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.916579 Apr 14 12:25:09 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 346/1029] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:25:08 2023] POST /compute/v2.1/servers => generated 399 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:25:09 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-317b9e5a-6eb1-48d6-98a8-bc36b7ae1a16 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:09 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-317b9e5a-6eb1-48d6-98a8-bc36b7ae1a16 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:09 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-317b9e5a-6eb1-48d6-98a8-bc36b7ae1a16 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:25:09 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "name": "network-vif-plugged", "status": "completed", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}, {"server_uuid": "88ea9bf2-f5e5-4629-a6e8-55a3ef69c654", "name": "network-vif-deleted", "tag": "04e58506-8191-400e-9aa7-bd8ffc6293ee"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:09 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-317b9e5a-6eb1-48d6-98a8-bc36b7ae1a16 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 200 len: 1236 microversion: 2.1 time: 0.087326 Apr 14 12:25:09 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:09 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:25:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:09 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Creating event network-vif-plugged:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:25:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] Creating event network-vif-deleted:04e58506-8191-400e-9aa7-bd8ffc6293ee for instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 on user Apr 14 12:25:09 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ad72dc14-961a-4f8b-a81c-c0ee27b525c3 req-d9736a61-95bf-41bb-8d1c-b17e8e6aad7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042370 Apr 14 12:25:09 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 343/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] Creating event network-changed:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:25:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-cc4dde2f-5bb9-4865-97f1-8d916006d7b6 req-8ae92486-12a2-4477-91fe-7f8c248afa47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031099 Apr 14 12:25:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 347/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:14 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "name": "network-vif-plugged", "status": "completed", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:14 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] Creating event network-vif-plugged:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:25:14 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-522ed768-6f11-4f61-90cf-d814174ef886 req-dbd9b453-7ffd-441d-bcc0-ee59ebada94b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095467 Apr 14 12:25:14 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 343/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "name": "network-vif-plugged", "status": "completed", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] Creating event network-vif-plugged:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:25:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-bf386144-d550-4944-8d30-55dc59fc1996 req-03f65d31-6497-43d3-9a81-1f88d4fc615d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042820 Apr 14 12:25:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 344/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-080cf076-7e14-4f52-94b8-ed34956e4dfa tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Action: 'create', calling method: .version_select at 0x7f43717eed40>, body: {"keypair": {"name": "tempest-TestShelveInstance-53342841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx73a5JRZ+Vcnm3BGIc9YGjGbFiNtAVL0mP06rY5GWLceZGaxSWT/qv0+RiU/G63lqlXep5Kc8i43AWTDBaUZb85XVPXi9LqBIdLi6RC3Ta56TQn5rmkT5zYjxJkAwSXw=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-080cf076-7e14-4f52-94b8-ed34956e4dfa tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting quotas for project 429cce7d6b244be8ba4f0ed36ed98863. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:25:31 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-080cf076-7e14-4f52-94b8-ed34956e4dfa tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting quotas for user 0dcf77e350494142983fef3fd95ec080 and project 429cce7d6b244be8ba4f0ed36ed98863. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:25:31 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-080cf076-7e14-4f52-94b8-ed34956e4dfa tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.199080 Apr 14 12:25:31 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 348/1035] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:25:31 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=10 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:36 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=10 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:36 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-660218859", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-53342841", "security_groups": [{"name": "tempest-secgroup-smoke-797689516"}], "networks": [{"uuid": "915c6366-7834-4d13-916f-c1513ddacc12"}], "block_device_mapping_v2": [{"uuid": "bac8fa14-5f8b-4159-ba79-b5b0fa473d99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:36 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] validate_networks() for [('915c6366-7834-4d13-916f-c1513ddacc12', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting quotas for project 429cce7d6b244be8ba4f0ed36ed98863. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Getting quotas for user 0dcf77e350494142983fef3fd95ec080 and project 429cce7d6b244be8ba4f0ed36ed98863. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:25:37 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bac8fa14-5f8b-4159-ba79-b5b0fa473d99',volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:25:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-28c2eb2a-78e5-43b6-b7fa-24fd72bbb0cf tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.842409 Apr 14 12:25:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 344/1036] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:25:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:25:37 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:37 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7a478df6-7777-47bd-a263-39bc3f87cf12 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:37 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7a478df6-7777-47bd-a263-39bc3f87cf12 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:37 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7a478df6-7777-47bd-a263-39bc3f87cf12 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:25:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7a478df6-7777-47bd-a263-39bc3f87cf12 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1081 microversion: 2.1 time: 0.078076 Apr 14 12:25:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 345/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:37 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1081 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:25:40 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:40 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] Creating event network-changed:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:25:40 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-31be78eb-fdfb-4d59-a5bf-2b3299aaaee4 req-42831414-50cf-41b3-8a9b-d6964adff27e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032599 Apr 14 12:25:40 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 349/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:46 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:46 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:25:46 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-655d10d2-991d-47de-ace7-728f46020134 req-e5277edf-c25a-43e3-ad5d-ebd86a3fc9f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056419 Apr 14 12:25:46 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 345/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:25:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-44e082bf-3139-4fe7-adab-032e1647e7fb req-53db014b-0220-4af9-8c9c-1b86ee9d713e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041705 Apr 14 12:25:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 346/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:25:57 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 HTTP/1.1 Apr 14 12:25:57 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:25:57 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:25:57 user devstack@n-api.service[61699]: Connection: close Apr 14 12:25:57 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:25:57 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:25:57 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:25:57 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:25:57 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:57 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:25:57 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:25:57 user devstack@n-api.service[61699]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:25:57 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:25:57 user devstack@n-api.service[61699]: method: > Apr 14 12:25:57 user devstack@n-api.service[61699]: exception: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. Apr 14 12:25:57 user devstack@n-api.service[61699]: action_args: {'id': '88ea9bf2-f5e5-4629-a6e8-55a3ef69c654'} Apr 14 12:25:57 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. Apr 14 12:25:57 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:25:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:25:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-ebfc7f02-6099-440c-a523-29d1b90765d4 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654" status: 404 len: 111 microversion: 2.1 time: 0.035140 Apr 14 12:25:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 350/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:57 2023] GET /compute/v2.1/servers/88ea9bf2-f5e5-4629-a6e8-55a3ef69c654 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:25:59 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:00 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:26:00 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5c810ef7-3318-49bf-a0a0-bd340d383051 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 200 len: 1544 microversion: 2.1 time: 0.594868 Apr 14 12:26:00 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:25:59 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 1544 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:26:04 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f HTTP/1.1 Apr 14 12:26:04 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:26:04 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:26:04 user devstack@n-api.service[61700]: Connection: close Apr 14 12:26:04 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:26:04 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:26:04 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:26:04 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:26:04 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:26:04 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:26:04 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:26:04 user devstack@n-api.service[61700]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:26:04 user devstack@n-api.service[61700]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:26:04 user devstack@n-api.service[61700]: method: > Apr 14 12:26:04 user devstack@n-api.service[61700]: exception: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61700]: action_args: {'id': '11e4aa91-7c03-46cc-8610-78f18bbd089f'} Apr 14 12:26:04 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:26:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-91dab3f5-4b20-493d-a409-24e854ad7695 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 404 len: 111 microversion: 2.1 time: 0.033676 Apr 14 12:26:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 347/1043] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:26:04 2023] DELETE /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] [instance: 11e4aa91-7c03-46cc-8610-78f18bbd089f] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] HTTP exception thrown: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Request method failure captured: Apr 14 12:26:04 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f HTTP/1.1 Apr 14 12:26:04 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:26:04 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:26:04 user devstack@n-api.service[61699]: Connection: close Apr 14 12:26:04 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:26:04 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:26:04 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:26:04 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:26:04 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUCRz16reoV8vt3TbuGZnQ5l2-ByTZNFpNS7xpLRfmAGY5lviZG5xydPWi7CUplBMBWTfAinQrKzCTsuFwoWQsG7f1Qrfvf0LHGHpF8utTPkhEf2A-A5ohIIb4ELQCiuOUgtMtjht-5pJmi-xr23e0g36gp7IpRqLfzIsRvl-w12IjE Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Project-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Project-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e4ff63247dd4535bcd86acfde76fd34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e4ff63247dd4535bcd86acfde76fd34"}]}] Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Tenant: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Tenant-Id: 3e4ff63247dd4535bcd86acfde76fd34 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1592133549 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-User: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:26:04 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:26:04 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:26:04 user devstack@n-api.service[61699]: X-User-Id: 7e264a59ff9b42e08095d0ce71e4d627 Apr 14 12:26:04 user devstack@n-api.service[61699]: X-User-Name: tempest-ServerActionsTestJSON-1592133549-project-member Apr 14 12:26:04 user devstack@n-api.service[61699]: method: > Apr 14 12:26:04 user devstack@n-api.service[61699]: exception: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61699]: action_args: {'id': '11e4aa91-7c03-46cc-8610-78f18bbd089f'} Apr 14 12:26:04 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. Apr 14 12:26:04 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:26:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Returning 404 to user: Instance 11e4aa91-7c03-46cc-8610-78f18bbd089f could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:26:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3ec84ad5-9091-47b3-9ec4-8c00c64fea10 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f" status: 404 len: 111 microversion: 2.1 time: 0.033633 Apr 14 12:26:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 351/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:26:04 2023] GET /compute/v2.1/servers/11e4aa91-7c03-46cc-8610-78f18bbd089f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:26:04 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c6734d02-85f7-4d94-8221-6358b2ccc277 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] Calling method '.version_select at 0x7f4371ae9000>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:26:04 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c6734d02-85f7-4d94-8221-6358b2ccc277 tempest-ServerActionsTestJSON-1592133549 tempest-ServerActionsTestJSON-1592133549-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086314618" status: 202 len: 0 microversion: 2.1 time: 0.029312 Apr 14 12:26:04 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 347/1045] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:26:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086314618 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:27 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:26:27 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-8c4d404d-ea50-4faa-94e0-d94ac06fc68c tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1430 microversion: 2.1 time: 0.227619 Apr 14 12:26:27 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:26:27 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1430 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:26:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1344788342", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "networks": [{"uuid": "9ed42a1c-e079-46f7-b368-3a430ba4e0f4"}]}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:26:29 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] validate_networks() for [('9ed42a1c-e079-46f7-b368-3a430ba4e0f4', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Getting quotas for project 62022b87cde84ab09e72c570f4f89623. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Getting quotas for user 182bf4ecd144494d91c6124547bcbb2c and project 62022b87cde84ab09e72c570f4f89623. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:26:30 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:26:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-121597b6-5940-40a6-a9f8-8c684c3bb34b tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.635822 Apr 14 12:26:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 352/1047] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:26:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:26:30 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:30 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:26:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2f8da2d2-8465-4ef5-8b3e-d24e6525ddad tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:26:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2f8da2d2-8465-4ef5-8b3e-d24e6525ddad tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:26:30 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-2f8da2d2-8465-4ef5-8b3e-d24e6525ddad tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182bf4ecd144494d91c6124547bcbb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62022b87cde84ab09e72c570f4f89623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:26:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2f8da2d2-8465-4ef5-8b3e-d24e6525ddad tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c" status: 200 len: 1208 microversion: 2.1 time: 0.083280 Apr 14 12:26:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 348/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:26:30 2023] GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:26:32 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:26:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:32 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] Creating event network-changed:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:26:32 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-63f06ee6-6c2b-41d0-85d1-e0562d609d48 req-88219710-4975-4bda-a235-65e77e17537c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027907 Apr 14 12:26:32 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 349/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:26:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "name": "network-vif-plugged", "status": "completed", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:26:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] Creating event network-vif-plugged:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:26:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-accaf47c-2424-443b-8365-f956a869e166 req-7994ce8c-7a48-4211-a18c-79a6093b762c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042961 Apr 14 12:26:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 353/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:26:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:26:37 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "name": "network-vif-plugged", "status": "completed", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:26:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:26:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:26:37 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:26:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] Creating event network-vif-plugged:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:26:37 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4664e6e2-97e2-44f4-b912-70b30487efd2 req-3482aa97-8933-4bb5-94ab-255353bc1f06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Apr 14 12:26:37 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 349/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:00 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:00 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-23cbfd42-19a6-46a4-aaa4-89b6aadf0a95 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.100302 Apr 14 12:27:00 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 350/1052] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:27:00 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:01 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:01 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d88882e2-e05f-4503-bcae-96f30eca5117 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/ips" status: 200 len: 107 microversion: 2.1 time: 0.051319 Apr 14 12:27:01 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 350/1053] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:27:01 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/ips => generated 107 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:01 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:01 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] Creating event network-changed:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:27:01 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-954f162a-95c2-4ff3-aa33-884b34813733 req-ab091ab2-979b-4587-b6bd-5a1429e960e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146869 Apr 14 12:27:01 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 354/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46c7cd9-3c97-4269-8c2a-7ac57e02cc37"}} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:04 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:04 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5d0b89ba-79d0-4ad2-8996-c806696ea07b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272953 Apr 14 12:27:04 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 351/1055] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:27:04 2023] POST /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:11 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-db6fcf56-b138-492d-82e9-7a29e7615e09 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: .version_select at 0x7f437263fc70>, body: {"keypair": {"name": "tempest-keypair-103300990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASklcwtP5aGUHg3huDk+iSFj8z3lv03neDMPl61N00clNPmudnKMrGmZ7kJ3Awk8Ntvhr8XB5fIK4ExwZufNgalLlXDLs1/af7xeg1rmBjFxkdfa2k3zF5tFMklSQ+vjA=="}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:12 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-db6fcf56-b138-492d-82e9-7a29e7615e09 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:27:12 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-db6fcf56-b138-492d-82e9-7a29e7615e09 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:27:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-db6fcf56-b138-492d-82e9-7a29e7615e09 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103245 Apr 14 12:27:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 351/1056] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:27:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:13 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:13 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1881217565", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d6bc94c-f0fd-4e85-8eab-51fca64de980"}], "security_groups": [{"name": "tempest-securitygroup--424729286"}], "key_name": "tempest-keypair-103300990", "user_data": "}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:13 user devstack@n-api.service[61699]: DEBUG nova.network.neutron [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] validate_networks() for [('3d6bc94c-f0fd-4e85-8eab-51fca64de980', None, None, None, None, None)] {{(pid=61699) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.virt.hardware [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Going to run 1 instances... {{(pid=61699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:27:14 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:27:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-fe09fa7f-e97c-4082-9f4d-beb51a10e2a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.654795 Apr 14 12:27:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 355/1057] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:27:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:27:14 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:14 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f9558c4a-4c2e-4585-874f-03ef29a7a216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:14 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f9558c4a-4c2e-4585-874f-03ef29a7a216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:14 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-f9558c4a-4c2e-4585-874f-03ef29a7a216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:27:14 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f9558c4a-4c2e-4585-874f-03ef29a7a216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 200 len: 1235 microversion: 2.1 time: 0.067977 Apr 14 12:27:14 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 352/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:27:14 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 1235 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:27:17 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:17 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] Creating event network-changed:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:27:17 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-57b06aac-89f1-4e3d-a1d6-278f10bb1545 req-4b116d49-7010-4fed-918f-36680af1937e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052845 Apr 14 12:27:17 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 352/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "name": "network-vif-plugged", "status": "completed", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] Creating event network-vif-plugged:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:27:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-d116e9c1-11d9-4587-a010-fd8e1d2f8bcd req-dec1a0fe-04bd-4e7e-92b5-6c9a00708cba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Apr 14 12:27:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 356/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:20 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182bf4ecd144494d91c6124547bcbb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62022b87cde84ab09e72c570f4f89623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:27:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-dbfdb9b9-1530-4439-9419-2e822bd3a6aa tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c" status: 200 len: 1486 microversion: 2.1 time: 0.154246 Apr 14 12:27:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 353/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:27:20 2023] GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c => generated 1486 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:27:21 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "name": "network-vif-plugged", "status": "completed", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:21 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] Creating event network-vif-plugged:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:27:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-22d252a0-0806-43c2-9778-0a150958e2b5 req-08e17e7d-2785-4d71-8e2e-d1b31ef507b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033753 Apr 14 12:27:21 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 353/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:28 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:27:28 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-a89c57ad-0468-47ff-80db-d0e3c67389e3 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1430 microversion: 2.1 time: 0.141936 Apr 14 12:27:28 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 357/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:27:28 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1430 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:27:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:29 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] Creating event network-changed:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:27:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-1b39d210-04cb-45ca-8d4d-96b7bf3b46bb req-f31ad2a2-2608-4b56-bdbc-96797e79b357 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032524 Apr 14 12:27:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 354/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:30 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lazy-loading 'flavor' on Instance uuid 22d88480-665d-4d11-b22f-998d58ed25f4 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:27:30 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-c69792ef-637e-4a1f-abfa-0a2bc3980b1a tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4/action" status: 202 len: 0 microversion: 2.1 time: 0.120297 Apr 14 12:27:30 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 354/1065] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:27:30 2023] POST /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:30 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:27:30 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-155a4bf1-09d9-45a3-97c4-148ba39c9b71 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1436 microversion: 2.1 time: 0.193373 Apr 14 12:27:30 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 358/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:27:30 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1436 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:27:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-unplugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] Creating event network-vif-unplugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:27:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-0919ece9-afe2-46f2-85ff-0dea02908276 req-2579139e-16c6-4517-b63a-4bdf121911fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034802 Apr 14 12:27:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 355/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:27:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}, {"name": "network-changed", "server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:27:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:27:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:27:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:27:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:27:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] Creating event network-changed:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:27:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-8659067f-8584-45fb-8081-3b05bc2ca07c req-7b2beb5f-b7bc-48fe-a2e2-9711e063e177 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032034 Apr 14 12:27:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 355/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:27:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=16 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:04 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:28:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-f9c9ad63-ff0b-4ce8-831b-785184bbe364 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 200 len: 1543 microversion: 2.1 time: 0.160336 Apr 14 12:28:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 359/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:28:04 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 1543 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=10 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:20 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:28:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-45d54602-b93b-4ad9-9973-b76827671389 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1496 microversion: 2.1 time: 0.228975 Apr 14 12:28:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 356/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:28:20 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1496 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:29 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:28:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-7fd439dd-bcee-41d7-8f69-8421302f1a34 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c" status: 204 len: 0 microversion: 2.1 time: 0.138362 Apr 14 12:28:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 356/1071] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:28:29 2023] DELETE /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:29 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182bf4ecd144494d91c6124547bcbb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62022b87cde84ab09e72c570f4f89623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:28:29 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c8db9f9d-e4f7-40bf-a22e-a534b7991c1e tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c" status: 200 len: 1492 microversion: 2.1 time: 0.187302 Apr 14 12:28:29 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 360/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:28:29 2023] GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c => generated 1492 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:28:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "name": "network-vif-unplugged", "status": "completed", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:28:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:29 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] Creating event network-vif-unplugged:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:28:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-7c72fed9-e7d6-4d10-a1ff-aa2cdf903cf7 req-83d11893-ca74-431c-af06-0ea41081d485 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035063 Apr 14 12:28:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 357/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:28:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "name": "network-vif-plugged", "status": "completed", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}, {"server_uuid": "bed9942b-9207-49ed-85d2-32523431cf1c", "name": "network-vif-deleted", "tag": "6358dca2-b191-4d0c-998e-8a250a1a116f"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:28:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:28:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:28:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:28:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Creating event network-vif-plugged:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:28:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] Creating event network-vif-deleted:6358dca2-b191-4d0c-998e-8a250a1a116f for instance bed9942b-9207-49ed-85d2-32523431cf1c on user Apr 14 12:28:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-769995ba-8964-4615-8127-81526748c987 req-e8d7be43-56f1-41e6-91c8-3802aa07e21d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029963 Apr 14 12:28:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 357/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:04 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:04 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-21b9be69-9692-4780-b972-eb15d4f8a1fa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.190295 Apr 14 12:29:04 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 361/1075] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:29:04 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/os-interface => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] Creating event network-changed:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-6f8587c4-f29c-4197-8b21-4e4c62873675 req-ef62c3c3-22af-4550-a9fa-e4b1ee8889ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075371 Apr 14 12:29:05 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 358/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:05 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8c7251a0-5014-42fc-89b9-b1427d0db9bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/ips" status: 200 len: 107 microversion: 2.1 time: 0.045005 Apr 14 12:29:05 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:29:05 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46c7cd9-3c97-4269-8c2a-7ac57e02cc37"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:29:05 user devstack@n-api.service[61699]: request: POST /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/os-volume_attachments HTTP/1.1 Apr 14 12:29:05 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:29:05 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:29:05 user devstack@n-api.service[61699]: Connection: close Apr 14 12:29:05 user devstack@n-api.service[61699]: Content-Length: 74 Apr 14 12:29:05 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:29:05 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:29:05 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:29:05 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:29:05 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:05 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:29:05 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:29:05 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:29:05 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:29:05 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:29:05 user devstack@n-api.service[61699]: Apr 14 12:29:05 user devstack@n-api.service[61699]: {"volumeAttachment": {"volumeId": "b46c7cd9-3c97-4269-8c2a-7ac57e02cc37"}} Apr 14 12:29:05 user devstack@n-api.service[61699]: method: > Apr 14 12:29:05 user devstack@n-api.service[61699]: exception: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 Apr 14 12:29:05 user devstack@n-api.service[61699]: action_args: {'server_id': 'f2f3f771-0dd9-4d26-a3e1-7872b6ef700e', 'body': {'volumeAttachment': {'volumeId': 'b46c7cd9-3c97-4269-8c2a-7ac57e02cc37'}}} Apr 14 12:29:05 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 Apr 14 12:29:05 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:05 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 400 to user: Invalid volume: volume b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 is already attached to instances: e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:29:05 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-45bbc6df-1f7e-43cb-b8a5-c23401f6ee22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113564 Apr 14 12:29:05 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 362/1078] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:29:05 2023] POST /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:29:05 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-cc98bb19-8000-40db-81c8-ca292c677612 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 204 len: 0 microversion: 2.1 time: 0.138662 Apr 14 12:29:05 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 359/1079] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:29:05 2023] DELETE /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:05 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:06 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:29:06 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-a08d2349-8ccc-4ead-b8a7-109db34ec774 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 200 len: 1549 microversion: 2.1 time: 0.268837 Apr 14 12:29:06 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 359/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:29:05 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 1549 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:29:06 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "name": "network-vif-unplugged", "status": "completed", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:06 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] Creating event network-vif-unplugged:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:29:06 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-fe48c659-3568-43e3-ad93-0e6e6794020a req-1baa7880-6b31-40e1-96d9-c7f6ef135767 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121315 Apr 14 12:29:06 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 363/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:07 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "name": "network-vif-deleted", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:07 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] Creating event network-vif-deleted:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:29:07 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-18a732ec-7017-467e-b149-7264fc9608bd req-cefeadde-1522-47e4-9dec-4ad9b79a4762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088631 Apr 14 12:29:07 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 360/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:08 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3f771-0dd9-4d26-a3e1-7872b6ef700e", "name": "network-vif-plugged", "status": "completed", "tag": "514b556d-4464-4940-9b03-ad93a2fb5c6c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:08 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] Creating event network-vif-plugged:514b556d-4464-4940-9b03-ad93a2fb5c6c for instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e on user Apr 14 12:29:08 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-be2a4fe6-d769-4894-849b-b83cf1b255ca req-d4f831dd-3fee-4cbc-9c55-6839c5081537 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028241 Apr 14 12:29:08 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 360/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=12 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] [instance: bed9942b-9207-49ed-85d2-32523431cf1c] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] HTTP exception thrown: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Request method failure captured: Apr 14 12:29:19 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c HTTP/1.1 Apr 14 12:29:19 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:29:19 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:29:19 user devstack@n-api.service[61699]: Connection: close Apr 14 12:29:19 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:29:19 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:29:19 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:29:19 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:29:19 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUZ0sw8eFm9mNYdecnWrZHTA7PEMN2fXmX4lXu51IUBtHuJbSWiYszBj0SX-d9rDew_ry3-hljadT_Cjjjva1IvV4dAUGFdCz6fW38XHOtenkcUDD37Nzf10EQ8NdYus0Kob9geNYaQyg1s5sE1_OQtwagYq8_l5E1_xgA07IXDj084 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Project-Id: 62022b87cde84ab09e72c570f4f89623 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Project-Name: tempest-VolumesActionsTest-1257339868 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62022b87cde84ab09e72c570f4f89623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/62022b87cde84ab09e72c570f4f89623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/62022b87cde84ab09e72c570f4f89623"}]}] Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Tenant: tempest-VolumesActionsTest-1257339868 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Tenant-Id: 62022b87cde84ab09e72c570f4f89623 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-VolumesActionsTest-1257339868 Apr 14 12:29:19 user devstack@n-api.service[61699]: X-User: tempest-VolumesActionsTest-1257339868-project-member Apr 14 12:29:19 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:29:19 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:29:19 user devstack@n-api.service[61699]: X-User-Id: 182bf4ecd144494d91c6124547bcbb2c Apr 14 12:29:19 user devstack@n-api.service[61699]: X-User-Name: tempest-VolumesActionsTest-1257339868-project-member Apr 14 12:29:19 user devstack@n-api.service[61699]: method: > Apr 14 12:29:19 user devstack@n-api.service[61699]: exception: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. Apr 14 12:29:19 user devstack@n-api.service[61699]: action_args: {'id': 'bed9942b-9207-49ed-85d2-32523431cf1c'} Apr 14 12:29:19 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. Apr 14 12:29:19 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] Returning 404 to user: Instance bed9942b-9207-49ed-85d2-32523431cf1c could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:29:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-5392d0cb-a7b8-467d-88f0-cc39703c2077 tempest-VolumesActionsTest-1257339868 tempest-VolumesActionsTest-1257339868-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c" status: 404 len: 111 microversion: 2.1 time: 0.035855 Apr 14 12:29:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 364/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:29:19 2023] GET /compute/v2.1/servers/bed9942b-9207-49ed-85d2-32523431cf1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61700) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 12:29:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7020b18b-753a-482b-bf33-d41e69893e19 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4/action" status: 202 len: 0 microversion: 2.1 time: 0.193222 Apr 14 12:29:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 361/1085] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 12:29:20 2023] POST /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=12 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:21 user devstack@n-api.service[61701]: DEBUG nova.policy [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61701) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:29:21 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d49140de-9502-41e7-959d-1e2c77988f9f tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1504 microversion: 2.1 time: 0.170817 Apr 14 12:29:21 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 361/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:29:20 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:29:27 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:27 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] Creating event network-changed:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:29:27 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-7948022e-262f-4cf2-bab3-1a0edd20da26 req-85c50178-371d-4e84-b5f4-0c036fefabee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037244 Apr 14 12:29:27 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 365/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:30 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:30 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:29:30 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-e220448c-ec0b-454f-bee1-7cd31c0cc2a7 req-1403101c-31b0-4d1d-afe0-e44e9230e9a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039103 Apr 14 12:29:30 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 362/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:32 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:29:32 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-4d84ace1-a503-4174-94b1-8f7d8f34379b req-618c76e5-860f-4f7c-aee9-26a5b33088cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079078 Apr 14 12:29:32 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 362/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:29:56 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e HTTP/1.1 Apr 14 12:29:56 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:29:56 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:29:56 user devstack@n-api.service[61699]: Connection: close Apr 14 12:29:56 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:29:56 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:29:56 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:29:56 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:29:56 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:29:56 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:29:56 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:29:56 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:29:56 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:29:56 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:29:56 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:29:56 user devstack@n-api.service[61699]: method: > Apr 14 12:29:56 user devstack@n-api.service[61699]: exception: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:29:56 user devstack@n-api.service[61699]: action_args: {'id': 'f2f3f771-0dd9-4d26-a3e1-7872b6ef700e'} Apr 14 12:29:56 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:29:56 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:29:56 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:29:56 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-747fc95d-51e9-401f-bc2f-73c49d74bf8e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 404 len: 111 microversion: 2.1 time: 0.037418 Apr 14 12:29:56 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 366/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:29:56 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:29:56 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:56 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:56 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f669493f-208d-4da4-8ff9-961bdbcb865a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '.version_select at 0x7f4371a505e0>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:56 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f669493f-208d-4da4-8ff9-961bdbcb865a tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-103300990" status: 202 len: 0 microversion: 2.1 time: 0.033774 Apr 14 12:29:56 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 363/1091] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:29:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-103300990 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:57 user devstack@n-api.service[61701]: DEBUG nova.objects.instance [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'services' on Instance uuid e4c20f68-5164-4e7e-b699-5d0ad9bd3141 {{(pid=61701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:29:57 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-62c16cb5-65f9-49e9-816a-1287c8368e55 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments/b46c7cd9-3c97-4269-8c2a-7ac57e02cc37" status: 202 len: 0 microversion: 2.1 time: 0.173050 Apr 14 12:29:57 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 363/1092] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:29:57 2023] DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments/b46c7cd9-3c97-4269-8c2a-7ac57e02cc37 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:29:57 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:29:57 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-4fd9bf49-bb14-4321-8782-65c51b553e8b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053335 Apr 14 12:29:57 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:29:57 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:11 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:30:11 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-f5da7762-bfd1-4214-8f64-afae71269497 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1549 microversion: 2.1 time: 0.159188 Apr 14 12:30:11 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 364/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:30:11 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:47 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:47 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-4449f95f-d21b-48d9-bb23-a844da3546dc tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.254659 Apr 14 12:30:47 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 364/1095] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:30:47 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141/os-volume_attachments => generated 25 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:47 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Going to try to terminate instance {{(pid=61699) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:30:48 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-557d26cf-6bac-49af-90ad-caccc4f22df1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 204 len: 0 microversion: 2.1 time: 0.119200 Apr 14 12:30:48 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 368/1096] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:30:47 2023] DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:48 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:30:48 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a80d7044-b8b4-4521-80f5-09969167df2d tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 200 len: 1669 microversion: 2.1 time: 0.196716 Apr 14 12:30:48 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 365/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:30:48 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 1669 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:30:48 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "name": "network-vif-unplugged", "status": "completed", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:30:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:48 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] Creating event network-vif-unplugged:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:30:48 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-1bc72f83-23ff-41d2-8cf2-b7cf0698c52f req-5b49b895-7632-4569-881f-68db48c740a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035054 Apr 14 12:30:48 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 365/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:30:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:30:50 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "name": "network-vif-deleted", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:30:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:50 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] Creating event network-vif-deleted:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:30:50 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-f039dd7f-4b12-4d90-8499-6624b19d3db7 req-24e88f4e-08d4-4e30-a656-346d038b5790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Apr 14 12:30:50 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 369/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:30:50 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c20f68-5164-4e7e-b699-5d0ad9bd3141", "name": "network-vif-plugged", "status": "completed", "tag": "9759ea45-36a6-4d4d-b74e-cb8731fbdcd7"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:30:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:30:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:30:50 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:30:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] Creating event network-vif-plugged:9759ea45-36a6-4d4d-b74e-cb8731fbdcd7 for instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 on user Apr 14 12:30:50 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-c68a8769-ee7c-473d-acb6-7fb647d188e0 req-fa99a249-b0bf-4499-b876-fd9171c3c88e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034670 Apr 14 12:30:50 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 366/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=8 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] Creating event network-changed:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:31:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-24a27f59-2dc3-481a-85c4-e58db658d7f4 req-0abcb1f8-9ce2-4780-905d-b395959bce1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037291 Apr 14 12:31:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 370/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:31:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:12 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Going to try to terminate instance {{(pid=61701) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:31:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-6798605d-7c0c-40c7-8c2f-c92593546d18 tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 204 len: 0 microversion: 2.1 time: 0.116630 Apr 14 12:31:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 366/1102] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:31:12 2023] DELETE /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=8 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:12 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcf77e350494142983fef3fd95ec080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429cce7d6b244be8ba4f0ed36ed98863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:31:12 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-ecd95da8-e0a8-44d5-a637-4d41f27e9bea tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 200 len: 1555 microversion: 2.1 time: 0.174071 Apr 14 12:31:12 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 367/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:31:12 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:31:14 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-unplugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}, {"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-plugged", "status": "completed", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}, {"server_uuid": "22d88480-665d-4d11-b22f-998d58ed25f4", "name": "network-vif-deleted", "tag": "8b52e74d-0e38-439d-8857-f07336dea29c"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:14 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Creating event network-vif-unplugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:31:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Creating event network-vif-plugged:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:31:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] Creating event network-vif-deleted:8b52e74d-0e38-439d-8857-f07336dea29c for instance 22d88480-665d-4d11-b22f-998d58ed25f4 on user Apr 14 12:31:14 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-3117fbe8-f6a3-4a0e-9150-b1aca0adb1cb req-0e789cc1-e52e-425f-b9b9-924a1825e8f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035603 Apr 14 12:31:14 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:31:38 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 HTTP/1.1 Apr 14 12:31:38 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:31:38 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:31:38 user devstack@n-api.service[61701]: Connection: close Apr 14 12:31:38 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:31:38 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:31:38 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:31:38 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:31:38 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:31:38 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:31:38 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:31:38 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:31:38 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:31:38 user devstack@n-api.service[61701]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:31:38 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:31:38 user devstack@n-api.service[61701]: method: > Apr 14 12:31:38 user devstack@n-api.service[61701]: exception: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:31:38 user devstack@n-api.service[61701]: action_args: {'id': 'e4c20f68-5164-4e7e-b699-5d0ad9bd3141'} Apr 14 12:31:38 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:31:38 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:31:38 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:31:38 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-5c5d3944-538a-4092-b176-094853b3c7bb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 404 len: 111 microversion: 2.1 time: 0.042279 Apr 14 12:31:38 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 367/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:31:38 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:31:38 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-5a628fcd-4c5f-49d6-a175-2303a372416e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '.version_select at 0x7f4371b55480>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:31:38 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:38 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:38 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-5a628fcd-4c5f-49d6-a175-2303a372416e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947744203" status: 202 len: 0 microversion: 2.1 time: 0.025230 Apr 14 12:31:38 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 368/1106] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:31:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947744203 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:31:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:39 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:31:39 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-d60b3612-eaf4-4182-a933-93bfc3cad254 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: .version_select at 0x7f43717a3b50>, body: {"keypair": {"name": "tempest-keypair-1226525242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2n5YSC8QMWr5ck/++fyFR/Fek+st2PLAyRrIwipvxs2xnAN6MraEIVp9207YHntKSVZ9PMpam6j0695iHSPTsBnHlLA/TzEiQ0thDtndaSKOfJf6+r+dyJvHmFdggZOA=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:39 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-d60b3612-eaf4-4182-a933-93bfc3cad254 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:31:39 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-d60b3612-eaf4-4182-a933-93bfc3cad254 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:31:39 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-d60b3612-eaf4-4182-a933-93bfc3cad254 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051404 Apr 14 12:31:39 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 372/1107] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:31:39 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-832590332", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d6bc94c-f0fd-4e85-8eab-51fca64de980"}], "security_groups": [{"name": "tempest-securitygroup--1028973442"}], "key_name": "tempest-keypair-1226525242", "user_data": "}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] validate_networks() for [('3d6bc94c-f0fd-4e85-8eab-51fca64de980', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:40 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:41 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:31:41 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:31:41 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:31:41 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:31:41 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-90eda379-e092-4ed0-b667-55fd3538090b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.675565 Apr 14 12:31:41 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 368/1108] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:31:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:31:41 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-7372f903-01ce-46c3-99b7-64e404f858e3 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:31:41 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-7372f903-01ce-46c3-99b7-64e404f858e3 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:31:41 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-7372f903-01ce-46c3-99b7-64e404f858e3 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:31:41 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-7372f903-01ce-46c3-99b7-64e404f858e3 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 200 len: 1235 microversion: 2.1 time: 0.087975 Apr 14 12:31:41 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 369/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:31:41 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:31:43 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:43 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] Creating event network-changed:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:31:43 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-c6b53982-eb37-41f9-afdd-7e126a6e5625 req-402719fb-936b-4de9-bcf0-c4168e278c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030665 Apr 14 12:31:43 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 373/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:45 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "name": "network-vif-plugged", "status": "completed", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:45 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] Creating event network-vif-plugged:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:31:45 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-79e13d69-68f8-45c5-93b5-2966c164eab5 req-5e5b803c-d168-4933-8511-41510fc1479d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050461 Apr 14 12:31:45 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 369/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:31:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:31:47 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "name": "network-vif-plugged", "status": "completed", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:31:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:31:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:31:47 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:31:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] Creating event network-vif-plugged:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:31:47 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-93826f85-46fd-4400-8db5-93308c24b371 req-5ac390c9-bc0e-4322-8cd2-e892628ea255 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Apr 14 12:31:47 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 370/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:31:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] [instance: 22d88480-665d-4d11-b22f-998d58ed25f4] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:32:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] HTTP exception thrown: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Request method failure captured: Apr 14 12:32:02 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 HTTP/1.1 Apr 14 12:32:02 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:32:02 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:32:02 user devstack@n-api.service[61699]: Connection: close Apr 14 12:32:02 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:32:02 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:32:02 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:32:02 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:32:02 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUY003Qn9xP6c0g_clZB9xkJgdVwR8dp1WPdwYtk1xi_c6oGt-Qj41iXR-0EBuWMYKHsQlRrRW2XQ0vR2kwGxtQIwYS6YUp64xsMOmZBoaZRedXtlmDO03ToPQIAFGq_sJDNjTXPoWd-d050a_-9RpWqNOUezA6OREPsVWZmBTLbze8 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Project-Id: 429cce7d6b244be8ba4f0ed36ed98863 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Project-Name: tempest-TestShelveInstance-1593326624 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/429cce7d6b244be8ba4f0ed36ed98863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/429cce7d6b244be8ba4f0ed36ed98863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/429cce7d6b244be8ba4f0ed36ed98863"}]}] Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Tenant: tempest-TestShelveInstance-1593326624 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Tenant-Id: 429cce7d6b244be8ba4f0ed36ed98863 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-TestShelveInstance-1593326624 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-User: tempest-TestShelveInstance-1593326624-project-member Apr 14 12:32:02 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:32:02 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:32:02 user devstack@n-api.service[61699]: X-User-Id: 0dcf77e350494142983fef3fd95ec080 Apr 14 12:32:02 user devstack@n-api.service[61699]: X-User-Name: tempest-TestShelveInstance-1593326624-project-member Apr 14 12:32:02 user devstack@n-api.service[61699]: method: > Apr 14 12:32:02 user devstack@n-api.service[61699]: exception: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. Apr 14 12:32:02 user devstack@n-api.service[61699]: action_args: {'id': '22d88480-665d-4d11-b22f-998d58ed25f4'} Apr 14 12:32:02 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. Apr 14 12:32:02 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:32:02 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Returning 404 to user: Instance 22d88480-665d-4d11-b22f-998d58ed25f4 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:32:02 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3030230b-4e06-47de-86a8-3ba79738cf5b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4" status: 404 len: 111 microversion: 2.1 time: 0.036276 Apr 14 12:32:02 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 374/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:32:02 2023] GET /compute/v2.1/servers/22d88480-665d-4d11-b22f-998d58ed25f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:32:02 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:02 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-95933c27-56b3-44ae-baac-5364e9ee524b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] Calling method '.version_select at 0x7f4371c96050>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:32:02 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-95933c27-56b3-44ae-baac-5364e9ee524b tempest-TestShelveInstance-1593326624 tempest-TestShelveInstance-1593326624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-53342841" status: 202 len: 0 microversion: 2.1 time: 0.033255 Apr 14 12:32:02 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 370/1114] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:32:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-53342841 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:32:31 user devstack@n-api.service[61700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5cc46bc5-340b-4f07-99ba-01d1549d9de6] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:32:31 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:32:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-511a411d-e809-4cba-bc80-c488b69a530b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 200 len: 1545 microversion: 2.1 time: 0.175155 Apr 14 12:32:31 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 371/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:32:31 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 1545 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:31 user devstack@n-api.service[61699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 12:33:31 user devstack@n-api.service[61699]: Fri Apr 14 12:33:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-interface (ip 10.0.0.210) !!! Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:31 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-b0eb77f0-421c-47d2-afcf-5eccc42e4777 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103964 Apr 14 12:33:31 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 375/1116] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:33:31 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:33:33 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:33:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] Creating event network-changed:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:33:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e558aeda-2b94-4027-b6a0-babd58260c0e req-8852354c-2992-4ef6-a5c3-9daf38bed746 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157582 Apr 14 12:33:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 371/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:33:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=6 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:34 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:34 user devstack@n-api.service[61700]: INFO oslo.messaging._drivers.impl_rabbit [-] [5cc46bc5-340b-4f07-99ba-01d1549d9de6] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54034. Apr 14 12:33:34 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-2e9571c4-a917-4163-9bd2-375d5589f814 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/ips" status: 200 len: 148 microversion: 2.1 time: 0.048916 Apr 14 12:33:34 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 372/1118] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:33:34 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d612e95-affc-40f1-9374-b67a25700c70"}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:36 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:37 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-c3b8d02e-00a8-439f-9cb6-ddf99549fdaa tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304651 Apr 14 12:33:37 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 376/1119] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:33:36 2023] POST /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d612e95-affc-40f1-9374-b67a25700c70"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:33:44 user devstack@n-api.service[61701]: request: POST /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments HTTP/1.1 Apr 14 12:33:44 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:33:44 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:33:44 user devstack@n-api.service[61701]: Connection: close Apr 14 12:33:44 user devstack@n-api.service[61701]: Content-Length: 74 Apr 14 12:33:44 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:33:44 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:33:44 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:33:44 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:33:44 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:33:44 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:33:44 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:33:44 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:33:44 user devstack@n-api.service[61701]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:33:44 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:33:44 user devstack@n-api.service[61701]: Apr 14 12:33:44 user devstack@n-api.service[61701]: {"volumeAttachment": {"volumeId": "4d612e95-affc-40f1-9374-b67a25700c70"}} Apr 14 12:33:44 user devstack@n-api.service[61701]: method: > Apr 14 12:33:44 user devstack@n-api.service[61701]: exception: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e Apr 14 12:33:44 user devstack@n-api.service[61701]: action_args: {'server_id': 'e52b7ccd-2e66-4579-bcdf-3059dfac872e', 'body': {'volumeAttachment': {'volumeId': '4d612e95-affc-40f1-9374-b67a25700c70'}}} Apr 14 12:33:44 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e Apr 14 12:33:44 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:33:44 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 400 to user: Invalid volume: volume 4d612e95-affc-40f1-9374-b67a25700c70 is already attached to instances: e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:33:44 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-8174208c-0c2a-45ce-9173-b577b84e81d1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113007 Apr 14 12:33:44 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 372/1120] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:33:44 2023] POST /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=4 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:44 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'services' on Instance uuid e52b7ccd-2e66-4579-bcdf-3059dfac872e {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:33:44 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a899f6b1-512f-4127-be87-81951ad43c22 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments/4d612e95-affc-40f1-9374-b67a25700c70" status: 202 len: 0 microversion: 2.1 time: 0.222557 Apr 14 12:33:44 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 373/1121] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:33:44 2023] DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments/4d612e95-affc-40f1-9374-b67a25700c70 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:33:44 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:33:45 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-cfc7f814-8544-486c-bc9f-928b99ca80de tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064223 Apr 14 12:33:45 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 377/1122] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:33:44 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-e18f91e9-62f8-458f-aad9-8e714f2f8548 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059519 Apr 14 12:34:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 373/1123] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:34:35 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:34:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-1f59928a-f654-438a-839a-22bfb511aaea tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 204 len: 0 microversion: 2.1 time: 0.199881 Apr 14 12:34:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 374/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:34:35 2023] DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "name": "network-vif-unplugged", "status": "completed", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:34:35 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:35 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:35 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-5f900b98-1e77-48ce-a942-c181f5b9fa83 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 200 len: 1670 microversion: 2.1 time: 0.403000 Apr 14 12:34:35 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 378/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:34:35 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:34:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] Creating event network-vif-unplugged:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:34:35 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-c160c9e6-1413-4818-a719-1e417cde6eca req-cb15db07-e182-4dbb-b9d6-6b3a01234727 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136790 Apr 14 12:34:35 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 374/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:34:37 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "name": "network-vif-deleted", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:34:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:37 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] Creating event network-vif-deleted:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:34:37 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-ff220a13-278b-4525-9df7-6c1078b0cec3 req-02d3e012-4733-4d2d-89f1-6a1d0e9913ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101793 Apr 14 12:34:37 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 375/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:34:37 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b7ccd-2e66-4579-bcdf-3059dfac872e", "name": "network-vif-plugged", "status": "completed", "tag": "ee784ad2-eed9-4260-8453-ec383447cf95"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:34:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:34:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:34:37 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:34:37 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] Creating event network-vif-plugged:ee784ad2-eed9-4260-8453-ec383447cf95 for instance e52b7ccd-2e66-4579-bcdf-3059dfac872e on user Apr 14 12:34:37 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-e9371e48-0439-463a-8b7f-a2d50b75f032 req-1a268b44-ec8a-4009-b037-31d5e40390bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Apr 14 12:34:37 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 379/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=8 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:25 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:35:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:35:26 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e HTTP/1.1 Apr 14 12:35:26 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:35:26 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:35:26 user devstack@n-api.service[61701]: Connection: close Apr 14 12:35:26 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:35:26 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:35:26 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:35:26 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:35:26 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:35:26 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:35:26 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:35:26 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:35:26 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:35:26 user devstack@n-api.service[61701]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:35:26 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:35:26 user devstack@n-api.service[61701]: method: > Apr 14 12:35:26 user devstack@n-api.service[61701]: exception: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:35:26 user devstack@n-api.service[61701]: action_args: {'id': 'e52b7ccd-2e66-4579-bcdf-3059dfac872e'} Apr 14 12:35:26 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:35:26 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:35:26 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:35:26 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-9493c5e8-6421-451b-aeb2-31a9866abfc2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 404 len: 111 microversion: 2.1 time: 0.039551 Apr 14 12:35:26 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 375/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:35:25 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:35:26 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:26 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:26 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-27886b8e-16ce-49e2-8256-468c1d21653b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '.version_select at 0x7f43718fb130>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:35:26 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-27886b8e-16ce-49e2-8256-468c1d21653b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226525242" status: 202 len: 0 microversion: 2.1 time: 0.037635 Apr 14 12:35:26 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 12:35:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226525242 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:35:26 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:26 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=8 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:35:26 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-7d3ae1da-700d-4a90-ba7a-a8a546fd32e2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: .version_select at 0x7f43717ed1b0>, body: {"keypair": {"name": "tempest-keypair-509267361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBt3aXEPux5x/euTPC70vUHsoPtPoWG2MGNlDSeYEqAvM9YUZyQaSt238vYpgnPmWTlfuVMYnPw8Z4ngWNZoWBlflp/CB0g8UzRZyRjFXHa3SvF7GenI77OnMqTAGAew=="}} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:35:26 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-7d3ae1da-700d-4a90-ba7a-a8a546fd32e2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:35:26 user devstack@n-api.service[61699]: DEBUG nova.quota [None req-7d3ae1da-700d-4a90-ba7a-a8a546fd32e2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'key_pairs'} {{(pid=61699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:35:26 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-7d3ae1da-700d-4a90-ba7a-a8a546fd32e2 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054707 Apr 14 12:35:26 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 380/1131] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 12:35:26 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176094221", "imageRef": "a84e226d-f438-4fb3-96fe-51f5960a6c87", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d6bc94c-f0fd-4e85-8eab-51fca64de980"}], "security_groups": [{"name": "tempest-securitygroup--1250457236"}], "key_name": "tempest-keypair-509267361", "user_data": "}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.network.neutron [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] validate_networks() for [('3d6bc94c-f0fd-4e85-8eab-51fca64de980', None, None, None, None, None)] {{(pid=61701) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image limits 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Flavor pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Image pref 0:0:0 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.virt.hardware [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.quota [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Getting quotas for user 609f2fce20c44000903c8a05e07ebd67 and project fa90860f65ab408aa00dfd6abb8af18b. Resources: {'instances', 'ram', 'cores'} {{(pid=61701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Going to run 1 instances... {{(pid=61701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 12:35:28 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a84e226d-f438-4fb3-96fe-51f5960a6c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 12:35:29 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-33c7927f-a1ce-4549-b880-e5aadbd0c453 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.685310 Apr 14 12:35:29 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 376/1132] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 12:35:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 12:35:29 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-a0bed3f7-c190-4bdc-b938-95e16a7c458c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:35:29 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-a0bed3f7-c190-4bdc-b938-95e16a7c458c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:35:29 user devstack@n-api.service[61700]: DEBUG nova.policy [None req-a0bed3f7-c190-4bdc-b938-95e16a7c458c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61700) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:35:29 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-a0bed3f7-c190-4bdc-b938-95e16a7c458c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 200 len: 1234 microversion: 2.1 time: 0.099972 Apr 14 12:35:29 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 377/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:35:29 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:35:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:35:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:31 user devstack@n-api.service[61699]: INFO nova.api.openstack.compute.server_external_events [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] Creating event network-changed:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:35:31 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [req-d3974c97-74ad-4aea-a9ae-ed96bf5c328c req-c113bcb4-f05b-4124-be10-1013f745524c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030841 Apr 14 12:35:31 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 381/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:35:33 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "name": "network-vif-plugged", "status": "completed", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:35:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:33 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] Creating event network-vif-plugged:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:35:33 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-1eb449ee-5ac5-4af9-9e4a-3b129b3f1246 req-15deec8c-02d7-44f2-b57d-09ef77baa8a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037514 Apr 14 12:35:33 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 377/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:35:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:35:35 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "name": "network-vif-plugged", "status": "completed", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:35:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:35:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:35:35 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:35:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] Creating event network-vif-plugged:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:35:35 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-86b5f3cc-a901-4800-a53c-68f499797983 req-fcedfc80-27e8-4583-a6fa-6ddabd0f4de1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037544 Apr 14 12:35:35 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 378/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:35:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell0:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:36:19 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:36:19 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-e4fb935e-41eb-48cf-8655-bb5d9978dccf tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 200 len: 1544 microversion: 2.1 time: 0.197402 Apr 14 12:36:19 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 382/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:36:19 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 1544 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=2 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell0:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:19 user devstack@n-api.service[61701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 12:37:19 user devstack@n-api.service[61701]: Fri Apr 14 12:37:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-interface (ip 10.0.0.210) !!! Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=6 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:19 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:19 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d383a540-22ca-4181-9cd4-c8562d452d60 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.108235 Apr 14 12:37:19 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 378/1138] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 12:37:19 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-interface => generated 283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell0:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:20 user devstack@n-api.service[61700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 12:37:20 user devstack@n-api.service[61700]: Fri Apr 14 12:37:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] Creating event network-changed:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:37:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-95f534bd-1575-47a8-b68a-726d400ae9d6 req-cc0097aa-f700-44d0-b6ee-00f7484b3e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070810 Apr 14 12:37:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 379/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:37:21 user devstack@n-api.service[61699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4abc02c-4f42-422e-8479-6b3aacc44375] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:21 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:21 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-974f63c5-7299-4548-ad5f-67c499ae31dd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/ips" status: 200 len: 147 microversion: 2.1 time: 0.040598 Apr 14 12:37:21 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 383/1140] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 12:37:21 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2419b52f-f8fb-4463-ad08-ae41af67611b"}} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:23 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:24 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-2415ec29-39ce-42bb-87bc-a904328de216 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289650 Apr 14 12:37:24 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 379/1141] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 12:37:23 2023] POST /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:31 user devstack@n-api.service[61700]: DEBUG nova.objects.instance [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lazy-loading 'services' on Instance uuid 1f55e425-e53d-4649-a068-752a764c5629 {{(pid=61700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 12:37:31 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-3e117806-77ab-430a-9f08-c1ba7b4f62a0 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments/2419b52f-f8fb-4463-ad08-ae41af67611b" status: 202 len: 0 microversion: 2.1 time: 0.175550 Apr 14 12:37:31 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 380/1142] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 12:37:31 2023] DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments/2419b52f-f8fb-4463-ad08-ae41af67611b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:37:31 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:37:31 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:37:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:31 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=4 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:37:31 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:37:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:37:32 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:37:32 user devstack@n-api.service[61699]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4abc02c-4f42-422e-8479-6b3aacc44375] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36534. Apr 14 12:37:32 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-bd3a94f1-1c07-40ae-945f-a78e7a5a317f tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076389 Apr 14 12:37:32 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 384/1143] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:37:31 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 12:38:22 user devstack@n-api.service[61701]: Fri Apr 14 12:38:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-d145f888-ef6a-41f2-86c3-37b9e5b1a61c tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069265 Apr 14 12:38:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 380/1144] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 12:38:22 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 12:38:22 user devstack@n-api.service[61700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 12:38:22 user devstack@n-api.service[61700]: Fri Apr 14 12:38:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 (ip 10.0.0.210) !!! Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=2 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Going to try to terminate instance {{(pid=61700) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 12:38:22 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bfe565e2-3ae8-47f9-84d9-03a9b745f9ac tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 204 len: 0 microversion: 2.1 time: 0.122078 Apr 14 12:38:22 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:38:22 2023] DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61699]: DEBUG nova.policy [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '609f2fce20c44000903c8a05e07ebd67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa90860f65ab408aa00dfd6abb8af18b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61699) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 12:38:22 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-1d6c13a6-5950-4a8b-97e5-9dd60535052b tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 200 len: 1668 microversion: 2.1 time: 0.178289 Apr 14 12:38:22 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 385/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:38:22 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "name": "network-vif-unplugged", "status": "completed", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:22 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.compute.server_external_events [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] Creating event network-vif-unplugged:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:38:22 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [req-e51c84a1-6359-4b4a-b7ce-bb2809283d75 req-6e8ea488-86f7-4504-861e-721cc234f4ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028864 Apr 14 12:38:22 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 381/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:38:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:38:24 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "name": "network-vif-plugged", "status": "completed", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}, {"server_uuid": "1f55e425-e53d-4649-a068-752a764c5629", "name": "network-vif-deleted", "tag": "985d0774-abf7-42c9-8495-5fdfa488641b"}]} {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 12:38:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:38:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:38:24 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:38:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Creating event network-vif-plugged:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:38:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.compute.server_external_events [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] Creating event network-vif-deleted:985d0774-abf7-42c9-8495-5fdfa488641b for instance 1f55e425-e53d-4649-a068-752a764c5629 on user Apr 14 12:38:24 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [req-93fa2952-bec3-4cc3-bb4f-46ed1433ec5a req-362d8fe9-8306-499b-a792-9ec64c1be5e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033285 Apr 14 12:38:24 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 382/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 12:38:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_api:SELECT=2 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG dbcounter [-] [61699] Writing DB stats nova_cell1:SELECT=6 {{(pid=61699) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:12 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 HTTP/1.1 Apr 14 12:39:12 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:39:12 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:39:12 user devstack@n-api.service[61699]: Connection: close Apr 14 12:39:12 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:39:12 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:39:12 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:39:12 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:39:12 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:12 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:12 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:12 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:39:12 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:39:12 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:12 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:12 user devstack@n-api.service[61699]: method: > Apr 14 12:39:12 user devstack@n-api.service[61699]: exception: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:12 user devstack@n-api.service[61699]: action_args: {'id': '1f55e425-e53d-4649-a068-752a764c5629'} Apr 14 12:39:12 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:12 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:12 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:12 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-9df4eb82-ee31-44e7-bbdd-a6cbb33b9ed1 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 404 len: 111 microversion: 2.1 time: 0.032694 Apr 14 12:39:12 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 386/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:39:12 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_api:SELECT=4 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:12 user devstack@n-api.service[61701]: DEBUG dbcounter [-] [61701] Writing DB stats nova_cell1:SELECT=8 {{(pid=61701) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:12 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-f04d1c07-5617-4b74-a36e-2c535fe58466 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '.version_select at 0x7f4371c43760>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:12 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-f04d1c07-5617-4b74-a36e-2c535fe58466 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509267361" status: 202 len: 0 microversion: 2.1 time: 0.051024 Apr 14 12:39:12 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 382/1150] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 12:39:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509267361 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG dbcounter [-] [61700] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61700) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:16 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 HTTP/1.1 Apr 14 12:39:16 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:39:16 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:39:16 user devstack@n-api.service[61700]: Connection: close Apr 14 12:39:16 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:39:16 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:39:16 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:39:16 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:39:16 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:16 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:16 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:39:16 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:39:16 user devstack@n-api.service[61700]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:16 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:16 user devstack@n-api.service[61700]: method: > Apr 14 12:39:16 user devstack@n-api.service[61700]: exception: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61700]: action_args: {'id': '1f55e425-e53d-4649-a068-752a764c5629'} Apr 14 12:39:16 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:16 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-bc814e46-bf29-484d-be8b-c771c72af0cb tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 404 len: 111 microversion: 2.1 time: 0.043314 Apr 14 12:39:16 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 383/1151] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:39:16 2023] DELETE /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: 1f55e425-e53d-4649-a068-752a764c5629] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:16 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 HTTP/1.1 Apr 14 12:39:16 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:39:16 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:39:16 user devstack@n-api.service[61699]: Connection: close Apr 14 12:39:16 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:39:16 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:39:16 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:39:16 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:39:16 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:16 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:16 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:16 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:39:16 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:39:16 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:16 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:16 user devstack@n-api.service[61699]: method: > Apr 14 12:39:16 user devstack@n-api.service[61699]: exception: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61699]: action_args: {'id': '1f55e425-e53d-4649-a068-752a764c5629'} Apr 14 12:39:16 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. Apr 14 12:39:16 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:16 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance 1f55e425-e53d-4649-a068-752a764c5629 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:16 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3dfff9ec-a332-4015-b3d0-810f9914dc91 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629" status: 404 len: 111 microversion: 2.1 time: 0.034661 Apr 14 12:39:16 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 387/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:39:16 2023] GET /compute/v2.1/servers/1f55e425-e53d-4649-a068-752a764c5629 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:20 user devstack@n-api.service[61701]: request: DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e HTTP/1.1 Apr 14 12:39:20 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:39:20 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:39:20 user devstack@n-api.service[61701]: Connection: close Apr 14 12:39:20 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:39:20 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:39:20 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:39:20 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:39:20 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61701]: method: > Apr 14 12:39:20 user devstack@n-api.service[61701]: exception: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: action_args: {'id': 'e52b7ccd-2e66-4579-bcdf-3059dfac872e'} Apr 14 12:39:20 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-93869782-febc-4c8c-a431-15be3d1f9535 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 404 len: 111 microversion: 2.1 time: 0.050115 Apr 14 12:39:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 383/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:39:20 2023] DELETE /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e52b7ccd-2e66-4579-bcdf-3059dfac872e] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:20 user devstack@n-api.service[61700]: request: GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e HTTP/1.1 Apr 14 12:39:20 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:39:20 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:39:20 user devstack@n-api.service[61700]: Connection: close Apr 14 12:39:20 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:39:20 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:39:20 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:39:20 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:39:20 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61700]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:20 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61700]: method: > Apr 14 12:39:20 user devstack@n-api.service[61700]: exception: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61700]: action_args: {'id': 'e52b7ccd-2e66-4579-bcdf-3059dfac872e'} Apr 14 12:39:20 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e52b7ccd-2e66-4579-bcdf-3059dfac872e could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:20 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-88a0615c-dd8b-4615-a4f3-2250d09401a8 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e" status: 404 len: 111 microversion: 2.1 time: 0.031442 Apr 14 12:39:20 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 384/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:39:20 2023] GET /compute/v2.1/servers/e52b7ccd-2e66-4579-bcdf-3059dfac872e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:20 user devstack@n-api.service[61699]: request: DELETE /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e HTTP/1.1 Apr 14 12:39:20 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:39:20 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:39:20 user devstack@n-api.service[61699]: Connection: close Apr 14 12:39:20 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:39:20 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:39:20 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:39:20 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:39:20 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:20 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61699]: method: > Apr 14 12:39:20 user devstack@n-api.service[61699]: exception: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61699]: action_args: {'id': 'f2f3f771-0dd9-4d26-a3e1-7872b6ef700e'} Apr 14 12:39:20 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:20 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-223f126c-dce8-4636-996d-540a473383fd tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 404 len: 111 microversion: 2.1 time: 0.028491 Apr 14 12:39:20 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 388/1155] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:39:20 2023] DELETE /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.compute.api [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: f2f3f771-0dd9-4d26-a3e1-7872b6ef700e] Fetching instance by UUID {{(pid=61701) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG oslo_concurrency.lockutils [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61701) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.wsgi [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:20 user devstack@n-api.service[61701]: request: GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e HTTP/1.1 Apr 14 12:39:20 user devstack@n-api.service[61701]: Accept: application/json Apr 14 12:39:20 user devstack@n-api.service[61701]: Accept-Encoding: identity Apr 14 12:39:20 user devstack@n-api.service[61701]: Connection: close Apr 14 12:39:20 user devstack@n-api.service[61701]: Content-Length: 0 Apr 14 12:39:20 user devstack@n-api.service[61701]: Content-Type: application/json Apr 14 12:39:20 user devstack@n-api.service[61701]: Host: 10.0.0.210 Apr 14 12:39:20 user devstack@n-api.service[61701]: Openstack-System-Scope: None Apr 14 12:39:20 user devstack@n-api.service[61701]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Domain-Id: None Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Domain-Name: None Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Identity-Status: Confirmed Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Is-Admin-Project: True Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Role: member,reader Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Roles: member,reader Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:20 user devstack@n-api.service[61701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Domain-Id: default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Domain-Name: Default Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:20 user devstack@n-api.service[61701]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:20 user devstack@n-api.service[61701]: method: > Apr 14 12:39:20 user devstack@n-api.service[61701]: exception: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: action_args: {'id': 'f2f3f771-0dd9-4d26-a3e1-7872b6ef700e'} Apr 14 12:39:20 user devstack@n-api.service[61701]: {{(pid=61701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. Apr 14 12:39:20 user devstack@n-api.service[61701]: ERROR nova.api.openstack.wsgi Apr 14 12:39:20 user devstack@n-api.service[61701]: DEBUG nova.api.openstack.wsgi [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance f2f3f771-0dd9-4d26-a3e1-7872b6ef700e could not be found. {{(pid=61701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:20 user devstack@n-api.service[61701]: INFO nova.api.openstack.requestlog [None req-7d250573-5b7a-4ca9-823d-e5113a77a8e5 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e" status: 404 len: 111 microversion: 2.1 time: 0.028215 Apr 14 12:39:20 user devstack@n-api.service[61701]: [pid: 61701|app: 0|req: 384/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:39:20 2023] GET /compute/v2.1/servers/f2f3f771-0dd9-4d26-a3e1-7872b6ef700e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG nova.compute.api [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61700) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG oslo_concurrency.lockutils [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61700) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:23 user devstack@n-api.service[61700]: INFO nova.api.openstack.wsgi [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:23 user devstack@n-api.service[61700]: request: DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 HTTP/1.1 Apr 14 12:39:23 user devstack@n-api.service[61700]: Accept: application/json Apr 14 12:39:23 user devstack@n-api.service[61700]: Accept-Encoding: identity Apr 14 12:39:23 user devstack@n-api.service[61700]: Connection: close Apr 14 12:39:23 user devstack@n-api.service[61700]: Content-Length: 0 Apr 14 12:39:23 user devstack@n-api.service[61700]: Content-Type: application/json Apr 14 12:39:23 user devstack@n-api.service[61700]: Host: 10.0.0.210 Apr 14 12:39:23 user devstack@n-api.service[61700]: Openstack-System-Scope: None Apr 14 12:39:23 user devstack@n-api.service[61700]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Domain-Id: None Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Domain-Name: None Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Identity-Status: Confirmed Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Is-Admin-Project: True Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Project-Domain-Id: default Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Project-Domain-Name: Default Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Role: member,reader Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Roles: member,reader Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:23 user devstack@n-api.service[61700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61700]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:23 user devstack@n-api.service[61700]: X-User-Domain-Id: default Apr 14 12:39:23 user devstack@n-api.service[61700]: X-User-Domain-Name: Default Apr 14 12:39:23 user devstack@n-api.service[61700]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:23 user devstack@n-api.service[61700]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:23 user devstack@n-api.service[61700]: method: > Apr 14 12:39:23 user devstack@n-api.service[61700]: exception: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61700]: action_args: {'id': 'e4c20f68-5164-4e7e-b699-5d0ad9bd3141'} Apr 14 12:39:23 user devstack@n-api.service[61700]: {{(pid=61700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61700]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61700]: DEBUG nova.api.openstack.wsgi [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. {{(pid=61700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:23 user devstack@n-api.service[61700]: INFO nova.api.openstack.requestlog [None req-c862243e-5d8b-4c51-9df5-ad17de71c4a7 tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 404 len: 111 microversion: 2.1 time: 0.031209 Apr 14 12:39:23 user devstack@n-api.service[61700]: [pid: 61700|app: 0|req: 385/1157] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 12:39:23 2023] DELETE /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Calling method '>' {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG nova.compute.api [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] [instance: e4c20f68-5164-4e7e-b699-5d0ad9bd3141] Fetching instance by UUID {{(pid=61699) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Acquiring lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG oslo_concurrency.lockutils [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Lock "4356620e-5366-41e8-9e39-3d2da8a8f9ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61699) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 12:39:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.wsgi [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] HTTP exception thrown: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Request method failure captured: Apr 14 12:39:23 user devstack@n-api.service[61699]: request: GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 HTTP/1.1 Apr 14 12:39:23 user devstack@n-api.service[61699]: Accept: application/json Apr 14 12:39:23 user devstack@n-api.service[61699]: Accept-Encoding: identity Apr 14 12:39:23 user devstack@n-api.service[61699]: Connection: close Apr 14 12:39:23 user devstack@n-api.service[61699]: Content-Length: 0 Apr 14 12:39:23 user devstack@n-api.service[61699]: Content-Type: application/json Apr 14 12:39:23 user devstack@n-api.service[61699]: Host: 10.0.0.210 Apr 14 12:39:23 user devstack@n-api.service[61699]: Openstack-System-Scope: None Apr 14 12:39:23 user devstack@n-api.service[61699]: User-Agent: python-urllib3/1.26.15 Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Auth-Token: gAAAAABkOUYiKSKDeMuBYZyniShbQakb61pJ19V_XioVKueaki8FA8O4K1Zy5W7JNVpojs1fMctEL27fmEOhQbsSejBl1iz6ioocer-OqM2_EDyelc8y7jnt5vUMXHVouyeLpEmeYKFaRMiXxrUXYd2JD0CVZvkMpgWvPjPnJGMMnb1v1i6djio Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Domain-Id: None Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Domain-Name: None Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Identity-Status: Confirmed Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Is-Admin-Project: True Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Project-Domain-Id: default Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Project-Domain-Name: Default Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Project-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Role: member,reader Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Roles: member,reader Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fa90860f65ab408aa00dfd6abb8af18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fa90860f65ab408aa00dfd6abb8af18b"}]}] Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Tenant: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Tenant-Id: fa90860f65ab408aa00dfd6abb8af18b Apr 14 12:39:23 user devstack@n-api.service[61699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1138909145 Apr 14 12:39:23 user devstack@n-api.service[61699]: X-User: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:23 user devstack@n-api.service[61699]: X-User-Domain-Id: default Apr 14 12:39:23 user devstack@n-api.service[61699]: X-User-Domain-Name: Default Apr 14 12:39:23 user devstack@n-api.service[61699]: X-User-Id: 609f2fce20c44000903c8a05e07ebd67 Apr 14 12:39:23 user devstack@n-api.service[61699]: X-User-Name: tempest-AttachVolumeNegativeTest-1138909145-project-member Apr 14 12:39:23 user devstack@n-api.service[61699]: method: > Apr 14 12:39:23 user devstack@n-api.service[61699]: exception: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61699]: action_args: {'id': 'e4c20f68-5164-4e7e-b699-5d0ad9bd3141'} Apr 14 12:39:23 user devstack@n-api.service[61699]: {{(pid=61699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. Apr 14 12:39:23 user devstack@n-api.service[61699]: ERROR nova.api.openstack.wsgi Apr 14 12:39:23 user devstack@n-api.service[61699]: DEBUG nova.api.openstack.wsgi [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] Returning 404 to user: Instance e4c20f68-5164-4e7e-b699-5d0ad9bd3141 could not be found. {{(pid=61699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 12:39:23 user devstack@n-api.service[61699]: INFO nova.api.openstack.requestlog [None req-3c533202-a7f8-4375-a280-a011b10f471e tempest-AttachVolumeNegativeTest-1138909145 tempest-AttachVolumeNegativeTest-1138909145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141" status: 404 len: 111 microversion: 2.1 time: 0.030905 Apr 14 12:39:23 user devstack@n-api.service[61699]: [pid: 61699|app: 0|req: 389/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 12:39:23 2023] GET /compute/v2.1/servers/e4c20f68-5164-4e7e-b699-5d0ad9bd3141 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)